00000001:02000400:2.0F:1787784312.576966:0:3298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787784332.741710:0:3520:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1787784335.451507:0:3583:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 873 MB/s 00000001:01000000:0.0F:1787784335.700960:0:3583:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 507 MB/s 00000001:01000000:2.0:1787784335.950821:0:3583:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3355 MB/s 00000020:02000000:3.0F:1787784337.260245:0:3613:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_54_g0142cbb 00000400:02000000:3.0:1787784338.387507:0:3628:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.141@tcp [8/256/0/180] 00008000:02000000:3.0:1787784342.618905:0:3778:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787784411.706159:0:5747:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787784427.921524:0:6497:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787784427.921531:0:6497:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1787784427.921533:0:6497:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787784427.921682:0:6497:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000558bfd1c 00000080:02000400:1.0:1787784427.921692:0:6497:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787784427.935123:0:6497:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787784427.935136:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787784427.935174:0:6497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000001ef40fd3) 00000020:00000080:1.0:1787784427.935192:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787784428.008763:0:6497:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787784428.008847:0:6497:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1787784428.036997:0:6497:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787784428.037316:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787784428.037323:0:6497:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787784428.037338:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9c831 00000020:01000004:2.0:1787784428.037344:0:6497:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787784428.037349:0:6497:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787784428.037353:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000558bfd1c from MGS 00000020:01000004:2.0:1787784428.037358:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787784428.037379:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000b246eb11) 00000020:00000080:2.0:1787784428.037389:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787784428.037497:0:6497:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000558bfd1c from MGS, refs=2 00080000:01000000:2.0:1787784428.037502:0:6497:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787784428.037510:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9c83f 00000100:00100000:2.0:1787784428.037609:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787784428.037749:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787784428.037755:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787784428.038499:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787784428.038507:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787784428.043937:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784428.044119:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787784428.044125:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787784428.045303:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787784428.045312:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787784428.045678:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787784428.045685:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787784428.046459:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784428.046463:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784428.046465:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784428.047062:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784428.047065:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784428.047066:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784428.047713:0:6497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787784428.051328:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787784428.296877:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3879 MB/s 00000001:01000000:2.0:1787784428.547917:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2350 MB/s 00000001:01000000:0.0:1787784428.798598:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 527 MB/s 00000001:01000000:2.0:1787784429.048221:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 767 MB/s 00080000:10000000:2.0:1787784429.055300:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:2.0:1787784429.065549:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787784429.076980:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787784429.078814:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787784429.078941:0:6497:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787784429.078995:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787784429.079184:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787784429.079207:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787784429.079555:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784429.079716:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787784429.079722:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787784429.082214:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787784429.082227:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787784429.082608:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787784429.082614:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787784429.083868:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787784429.083890:0:6497:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.141@tcp' 00000020:01000004:2.0:1787784429.083891:0:6497:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787784429.083934:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.141@tcp (typ=mgc) 00000020:00000080:2.0:1787784429.083950:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.141@tcp (000000001bc81a1e) 00000020:00000080:2.0:1787784429.083964:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787784429.084058:0:6497:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009a32b3b8@MGC192.168.202.141@tcp: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1787784429.084217:0:6497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.141@tcp-0 is initialized 00000040:01000000:2.0:1787784429.084223:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787784429.084605:0:6517:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787784429.088268:0:6518:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787784429.088328:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.141@tcp (uuid ee96db03-39cf-4d18-a974-880a628ded6e) 00000020:00000080:0.0:1787784429.088354:0:6497:0:(genops.c:1385:class_connect()) connect: client ee96db03-39cf-4d18-a974-880a628ded6e, cookie 0x88ace7295d9c84d 00000100:00080000:0.0:1787784429.088366:0:6497:0:(import.c:510:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784429.088372:0:6497:0:(import.c:624:import_select_connection()) MGC192.168.202.141@tcp: import 000000009a32b3b8 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784429.088404:0:6497:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000089139807 x1874627750002816/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784429.095228:0:6497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ee96db03-39cf-4d18-a974-880a628ded6e->MGS 00000020:01000004:0.0:1787784429.095257:0:6497:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787784429.095285:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787784429.095313:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000017e92c54) 00000020:00000080:0.0:1787784429.095333:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787784429.098204:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000089139807 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee96db03-39cf-4d18-a974-880a628ded6e:3643:1874627750002816:0@lo:250: 00000100:00100000:1.0:1787784429.098311:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784429.100628:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750002816 00000100:00100000:1.0:1787784429.100646:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750002816 00000100:00100000:1.0:1787784429.100698:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784429.100705:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfd350c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1874627750002816:12345-0@lo:250: 00010000:00080000:1.0:1787784429.100733:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ee96db03-39cf-4d18-a974-880a628ded6e@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:1.0:1787784429.100818:0:6513:0:(genops.c:1385:class_connect()) connect: client ee96db03-39cf-4d18-a974-880a628ded6e, cookie 0x88ace7295d9c85b 00000100:00080000:1.0:1787784429.100951:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000c23897b7 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784429.101040:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfd350c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+5:3643:x1874627750002816:12345-0@lo:250: Request processed in 334us (2729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784429.101055:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784429.101124:0:3643:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787784429.101133:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.141@tcp: connect to target with instance 0 00000100:00080000:1.0:1787784429.101140:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787784429.101145:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787784429.101148:0:3643:0:(import.c:65:import_set_state_nolock()) 000000009a32b3b8 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787784429.101151:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787784429.101160:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787784429.101165:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000089139807 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee96db03-39cf-4d18-a974-880a628ded6e:3643:1874627750002816:0@lo:250: 00000100:00100000:1.0:1787784429.126234:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784429.127194:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787784429.127201:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787784429.135736:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787784429.135755:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787784429.136409:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787784429.136418:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787784429.138678:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784429.138898:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787784429.138904:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787784429.140610:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787784429.140622:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787784429.183897:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784429.184116:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787784429.184123:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787784429.185545:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787784429.185557:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787784429.187059:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784429.187229:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787784429.187234:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787784429.188046:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787784429.188055:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787784429.191321:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784429.191663:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787784429.191669:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787784429.193164:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787784429.193175:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787784429.193824:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784429.193998:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787784429.194003:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787784429.195085:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787784429.195094:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787784429.229402:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784429.234523:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787784429.234535:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787784429.241662:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787784429.241751:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787784429.245518:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787784429.249893:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787784429.251033:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787784429.251058:0:6497:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787784429.251064:0:6497:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787784429.251164:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787784429.251194:0:6497:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787784429.251199:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787784429.251201:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787784429.251202:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784429.251204:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784429.251205:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784429.251207:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784429.251208:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784429.251209:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787784429.251210:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784429.251212:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784429.251213:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784429.251214:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784429.251219:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787784429.251221:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784429.251222:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787784429.251224:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784429.251225:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784429.251226:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784429.251226:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784429.251227:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784429.251228:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787784429.251229:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784429.251230:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784429.251231:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784429.251232:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784429.251255:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787784429.251277:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004bffd905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750002944:0@lo:253: 00000100:00100000:2.0:1787784429.251608:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784429.251667:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000605ce7bd going to sleep for 11 seconds 00000100:00100000:3.0:1787784429.251750:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750002944 00000100:00100000:3.0:1787784429.251756:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750002944 00000100:00100000:3.0:1787784429.251846:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784429.251855:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ad19828 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+5:6497:x1874627750002944:12345-0@lo:253: 20000000:01000000:3.0:1787784429.251896:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787784429.251899:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787784429.252955:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787784429.253502:0:6516:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787784429.253849:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784429.255440:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787784429.261688:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787784429.261706:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787784429.261711:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787784429.261714:0:6516:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787784429.261728:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787784429.261962:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784429.262109:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787784429.262124:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787784429.262362:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787784429.262382:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787784429.262397:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787784429.262592:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787784429.262601:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787784429.262616:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787784429.262623:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787784429.262636:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787784429.262640:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787784429.262651:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787784429.262663:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787784429.262691:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787784429.262696:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787784429.262703:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784429.262933:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787784429.262944:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787784429.262958:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787784429.262970:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787784429.262981:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787784429.262988:0:6516:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787784429.263009:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787784429.263015:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787784429.263026:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787784429.263038:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787784429.263050:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787784429.263068:0:6516:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787784429.263090:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787784429.263097:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787784429.263107:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787784429.263119:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787784429.263304:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787784429.263324:0:6516:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787784429.263331:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787784429.266460:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787784429.266842:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787784429.266871:0:6516:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.141@tcp for mdt 20000000:01000000:3.0:1787784429.266874:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:3.0:1787784429.266888:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787784429.266894:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787784429.266904:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787784429.266909:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:3.0:1787784429.266918:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787784429.266924:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787784429.266934:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787784429.266945:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787784429.266969:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787784429.266972:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787784429.266976:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787784429.267029:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787784429.267031:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787784429.267956:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787784429.268150:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787784429.268174:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787784429.268187:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787784429.268197:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787784429.268198:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787784429.269799:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787784429.270101:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787784429.270127:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787784429.270157:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1787784429.270171:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787784429.270173:0:6516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787784429.270178:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787784429.270186:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787784429.270192:0:6516:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787784429.270198:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787784429.270764:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787784429.271012:0:6516:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787784429.283947:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787784429.286309:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787784429.286403:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787784429.286424:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787784429.286446:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ddf30866/0x88ace7295d9c862 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.286462:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ddf30866/0x88ace7295d9c862 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.286471:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ddf30866/0x88ace7295d9c862 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.286478:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ddf30866/0x88ace7295d9c862 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.286484:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ddf30866/0x88ace7295d9c862 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.286490:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ddf30866/0x88ace7295d9c862 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.286496:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ddf30866 already unused, calling callback (00000000b2725807) 00010000:00010000:3.0:1787784429.286499:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ddf30866/0x88ace7295d9c862 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.286523:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ddf30866/0x88ace7295d9c862 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.286536:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ddf30866/0x88ace7295d9c862 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.286543:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ddf30866/0x88ace7295d9c862 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.286548:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ddf30866/0x88ace7295d9c862 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787784429.286576:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787784429.297890:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ad19828 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+5:6497:x1874627750002944:12345-0@lo:253: Request processed in 46028us (46275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784429.297905:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784429.298956:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004bffd905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750002944:0@lo:253: 10000000:01000000:0.0:1787784429.298975:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787784429.298978:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787784429.298980:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787784429.298981:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784429.298983:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787784429.298984:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784429.298986:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784429.298987:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787784429.298988:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787784429.298989:0:6497:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787784429.298991:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784429.298992:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787784429.299014:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000558bfd1c from lustre-MDT0000 10000000:01000000:0.0:1787784429.299046:0:6497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787784429.299049:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787784429.299053:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8951cfef0000 10000000:01000000:0.0:1787784429.299057:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787784429.299065:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8951cfef0000 from 1 10000000:01000000:0.0:1787784429.299069:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787784429.299108:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.299119:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.299129:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784429.299162:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e325e34a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750003072:0@lo:101: 00000100:00100000:0.0:1787784429.299208:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784429.299250:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf4293db going to sleep for 11 seconds 00000100:00100000:1.0:1787784429.299379:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750003072 00000100:00100000:1.0:1787784429.299385:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750003072 00000100:00100000:1.0:1787784429.299429:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784429.299438:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb3fb4dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+5:6497:x1874627750003072:12345-0@lo:101: 00010000:00010000:1.0:1787784429.299450:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784429.299463:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de3f49dc/0x88ace7295d9c870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c869 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.299485:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de3f49dc/0x88ace7295d9c870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c869 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.299502:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de3f49dc/0x88ace7295d9c870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c869 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.299511:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de3f49dc, rc 0) 00000100:00100000:1.0:1787784429.299554:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb3fb4dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+6:6497:x1874627750003072:12345-0@lo:101: Request processed in 118us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784429.299561:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784429.299641:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e325e34a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750003072:0@lo:101: 00010000:00010000:0.0:1787784429.299653:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c870 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.299659:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c870 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784429.299702:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e325e34a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750003200:0@lo:501: 00000100:00100000:0.0:1787784429.299725:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784429.299744:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf4293db going to sleep for 11 seconds 00000100:00100000:3.0:1787784429.299764:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750003200 00000100:00100000:3.0:1787784429.299798:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750003200 00000100:00100000:3.0:1787784429.299830:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784429.299837:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000954ae163 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+6:6497:x1874627750003200:12345-0@lo:501: 00000100:00100000:3.0:1787784429.299932:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000954ae163 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+6:6497:x1874627750003200:12345-0@lo:501: Request processed in 96us (206us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784429.299940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784429.299976:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e325e34a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750003200:0@lo:501: 10000000:01000000:0.0:1787784429.300002:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787784429.300022:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c870 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.300030:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c870 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784429.300037:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8951d08ed800 10000000:01000000:0.0:1787784429.300041:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787784429.300044:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8951d08ed800 10000000:01000000:0.0:1787784429.300047:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787784429.300049:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8951d08ed800 from 1 10000000:01000000:0.0:1787784429.300052:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787784429.300066:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000099b8e024/0x88ace7295d9c877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.300074:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000099b8e024/0x88ace7295d9c877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.300092:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000099b8e024/0x88ace7295d9c877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784429.300103:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e325e34a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750003328:0@lo:101: 00000100:00100000:0.0:1787784429.300129:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784429.300167:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750003328 00000100:00100000:3.0:1787784429.300173:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750003328 00000100:00100000:0.0:1787784429.300174:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf4293db going to sleep for 11 seconds 00000100:00100000:0.0:1787784429.300206:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784429.300214:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5bdf7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+6:6497:x1874627750003328:12345-0@lo:101: 00010000:00010000:0.0:1787784429.300222:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784429.300231:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032eb0596/0x88ace7295d9c87e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c877 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.300244:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032eb0596/0x88ace7295d9c87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c877 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.300252:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032eb0596/0x88ace7295d9c87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c877 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.300258:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032eb0596, rc 0) 00000100:00100000:0.0:1787784429.300292:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5bdf7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+7:6497:x1874627750003328:12345-0@lo:101: Request processed in 80us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784429.300298:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784429.300331:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e325e34a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750003328:0@lo:101: 00010000:00010000:3.0:1787784429.300343:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000099b8e024/0x88ace7295d9c877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.300361:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000099b8e024/0x88ace7295d9c877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784429.300373:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787784429.300388:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000099b8e024/0x88ace7295d9c877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.300395:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000099b8e024/0x88ace7295d9c877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784429.300401:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787784429.300404:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784429.300408:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8951d08ed800 10000000:01000000:3.0:1787784429.300410:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787784429.300412:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787784429.300414:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787784429.300429:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.300436:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.300443:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784429.300454:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095a222dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750003456:0@lo:101: 00000100:00100000:3.0:1787784429.300483:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784429.300497:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000007608d3a4 going to sleep for 11 seconds 00000100:00100000:1.0:1787784429.300508:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750003456 00000100:00100000:1.0:1787784429.300514:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750003456 00000100:00100000:1.0:1787784429.300542:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784429.300547:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f2e8976 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+7:6497:x1874627750003456:12345-0@lo:101: 00010000:00010000:1.0:1787784429.300553:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784429.300559:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c88c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c885 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.300582:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c88c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c885 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.300589:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c88c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c885 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.300595:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008c4b4de5, rc 0) 00000100:00100000:1.0:1787784429.300628:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f2e8976 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+8:6497:x1874627750003456:12345-0@lo:101: Request processed in 80us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784429.300635:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784429.300642:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095a222dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750003456:0@lo:101: 00010000:00010000:3.0:1787784429.300654:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c88c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.300661:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c88c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784429.300704:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095a222dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750003584:0@lo:501: 00000100:00100000:3.0:1787784429.300728:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784429.300748:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000007608d3a4 going to sleep for 11 seconds 00000100:00100000:1.0:1787784429.301261:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750003584 00000100:00100000:1.0:1787784429.301266:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750003584 00000100:00100000:1.0:1787784429.301296:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784429.301309:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069561ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+8:6497:x1874627750003584:12345-0@lo:501: 00000100:00100000:1.0:1787784429.301410:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069561ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+9:6497:x1874627750003584:12345-0@lo:501: Request processed in 102us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784429.301417:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787784429.301485:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095a222dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750003584:0@lo:501: 00000100:00100000:0.0:1787784429.301511:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e268f5fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750003712:0@lo:503: 00000100:00100000:0.0:1787784429.301550:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784429.301587:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf4293db going to sleep for 11 seconds 00000100:00100000:1.0:1787784429.301638:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750003712 00000100:00100000:1.0:1787784429.301642:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750003712 00000100:00100000:1.0:1787784429.301673:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784429.301679:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dcbe750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+9:6497:x1874627750003712:12345-0@lo:503: 00000100:00100000:1.0:1787784429.301753:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dcbe750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+9:6497:x1874627750003712:12345-0@lo:503: Request processed in 75us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784429.301760:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784429.301909:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e268f5fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750003712:0@lo:503: 00000100:00100000:0.0:1787784429.303188:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e268f5fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:6543:1874627750003840:0@lo:502: 00000100:00100000:0.0:1787784429.303247:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784429.303285:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd70b86e going to sleep for 11 seconds 00000100:00100000:3.0:1787784429.303289:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750003840 00000100:00100000:3.0:1787784429.303295:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750003840 00000100:00100000:3.0:1787784429.303350:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784429.303358:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd40e0ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+9:6543:x1874627750003840:12345-0@lo:502: 00000100:00100000:3.0:1787784429.303467:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd40e0ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+9:6543:x1874627750003840:12345-0@lo:502: Request processed in 110us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784429.303475:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784429.303534:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e268f5fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:6543:1874627750003840:0@lo:502: 00000020:01000000:0.0:1787784429.303560:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784429.303581:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784429.303583:0:6543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787784429.303587:0:6543:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787784429.303590:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784429.303603:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c406886a) 00000020:00000080:0.0:1787784429.303618:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787784429.303622:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787784429.303726:0:6543:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787784429.303732:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9c89a 00000020:00000080:0.0:1787784429.304051:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787784429.304056:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784429.304059:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784429.304061:0:6543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787784429.304063:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784429.304066:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784429.304068:0:6543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787784429.304071:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784429.304078:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000bac9be6d) 00000020:00000080:0.0:1787784429.304086:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787784429.304090:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787784429.304091:0:6543:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787784429.304094:0:6543:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787784429.304099:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787784429.306019:0:6543:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000558bfd1c from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787784429.306041:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000b364781) 00000020:00000080:0.0:1787784429.306072:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787784429.306511:0:6543:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787784429.306520:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9c8af 00000020:00000080:0.0:1787784429.306666:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787784429.306672:0:6543:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787784429.306676:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x88ace7295d9c8b6 00080000:01000000:0.0:1787784429.306683:0:6543:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787784429.306685:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9c8bd 00080000:10000000:0.0:1787784429.307494:0:6543:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1787784429.307658:0:6543:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787784429.313356:0:6543:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787784429.420673:0:6543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787784429.421030:0:6543:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787784429.428007:0:6543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787784429.428752:0:6543:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787784429.436992:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000385bb457) 00000020:00000080:2.0:1787784429.437015:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787784429.437102:0:6543:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787784429.437297:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9c8cb 00000020:00000080:2.0:1787784429.439038:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787784429.440672:0:6543:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1787784429.446617:0:6543:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1787784429.451614:0:6543:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1787784429.460079:0:6543:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1787784429.466525:0:6543:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1787784429.468705:0:6543:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1787784429.470237:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x88ace7295d9c8d2 00000020:00000080:0.0:1787784429.471785:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787784429.471798:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784429.471805:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784429.471807:0:6543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787784429.471811:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784429.471815:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784429.471816:0:6543:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787784429.471819:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787784429.471820:0:6543:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787784429.471823:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784429.471825:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784429.471826:0:6543:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787784429.471828:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784429.471831:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784429.471833:0:6543:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787784429.471836:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787784429.471879:0:6543:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787784429.471935:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e268f5fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:6543:1874627750003968:0@lo:502: 00000100:00100000:0.0:1787784429.472017:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784429.472083:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cdce199c going to sleep for 11 seconds 00000100:00100000:3.0:1787784429.472496:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750003968 00000100:00100000:3.0:1787784429.472504:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750003968 00000100:00100000:3.0:1787784429.472552:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787784429.472560:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000100f6715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+9:6543:x1874627750003968:12345-0@lo:502: 00000100:00100000:3.0:1787784429.472701:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000100f6715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+9:6543:x1874627750003968:12345-0@lo:502: Request processed in 141us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784429.472709:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784429.472743:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e268f5fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:6543:1874627750003968:0@lo:502: 00000020:01000000:0.0:1787784429.472811:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784429.472817:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784429.472819:0:6543:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787784429.472822:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787784429.473082:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787784429.473102:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787784429.473118:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c88c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.473325:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c88c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784429.473334:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951d08ed800 from 1 10000000:01000000:3.0:1787784429.473337:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787784429.473366:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.473372:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.473457:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784429.473474:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095a222dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004096:0@lo:101: 00000100:00100000:3.0:1787784429.473510:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784429.473554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750004096 00000100:00100000:0.0:1787784429.473559:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750004096 00000100:00100000:0.0:1787784429.473645:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784429.473652:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c3f6a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+9:6497:x1874627750004096:12345-0@lo:101: 00010000:00010000:0.0:1787784429.473662:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784429.473674:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001695abed/0x88ace7295d9c8e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c8d9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.473695:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001695abed/0x88ace7295d9c8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c8d9 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.473704:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001695abed/0x88ace7295d9c8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c8d9 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.473712:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001695abed, rc 0) 00000100:00100000:3.0:1787784429.473743:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000026b5e2ee going to sleep for 11 seconds 00000100:00100000:0.0:1787784429.473748:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c3f6a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+10:6497:x1874627750004096:12345-0@lo:101: Request processed in 95us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784429.473756:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787784429.473763:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095a222dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004096:0@lo:101: 00010000:00010000:3.0:1787784429.473806:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c8e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.473815:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c8e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784429.476728:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095a222dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004224:0@lo:256: 00000100:00100000:3.0:1787784429.476831:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784429.476866:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000026b5e2ee going to sleep for 11 seconds 00000100:00100000:1.0:1787784429.476988:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750004224 00000100:00100000:1.0:1787784429.476997:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750004224 00000100:00100000:1.0:1787784429.477049:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787784429.477058:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cd5a54c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+10:6497:x1874627750004224:12345-0@lo:256: 20000000:01000000:1.0:1787784429.477082:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787784429.477087:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787784429.477189:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cd5a54c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+10:6497:x1874627750004224:12345-0@lo:256: Request processed in 131us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784429.477197:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784429.477356:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095a222dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004224:0@lo:256: 10000000:01000000:0.0:1787784429.477963:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787784429.477979:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c8e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.477990:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c8e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784429.478010:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951d08ed800 from 1 10000000:01000000:0.0:1787784429.478012:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784429.478041:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.478048:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.478056:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784429.478069:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e268f5fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004352:0@lo:101: 00000100:00100000:0.0:1787784429.478105:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784429.478143:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084000410 going to sleep for 11 seconds 00000100:00100000:2.0:1787784429.478228:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750004352 00000100:00100000:2.0:1787784429.478234:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750004352 00000100:00100000:2.0:1787784429.478272:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784429.478279:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f688b6ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+10:6497:x1874627750004352:12345-0@lo:101: 00010000:00010000:2.0:1787784429.478287:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784429.478301:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc863391/0x88ace7295d9c8ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c8e7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784429.478320:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc863391/0x88ace7295d9c8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c8e7 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784429.478328:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc863391/0x88ace7295d9c8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c8e7 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784429.478335:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc863391, rc 0) 00000100:00100000:2.0:1787784429.478382:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f688b6ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+11:6497:x1874627750004352:12345-0@lo:101: Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784429.478388:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784429.478515:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e268f5fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004352:0@lo:101: 00010000:00010000:0.0:1787784429.478527:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c8ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.478535:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c8ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784429.478601:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e268f5fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004480:0@lo:501: 00000100:00100000:0.0:1787784429.478627:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784429.478650:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084000410 going to sleep for 11 seconds 00000100:00100000:3.0:1787784429.478668:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750004480 00000100:00100000:3.0:1787784429.478674:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750004480 00000100:00100000:3.0:1787784429.478711:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787784429.478719:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa8847d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+11:6497:x1874627750004480:12345-0@lo:501: 00000100:00100000:3.0:1787784429.478902:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa8847d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+11:6497:x1874627750004480:12345-0@lo:501: Request processed in 184us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784429.478909:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784429.479180:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e268f5fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004480:0@lo:501: 00000100:00100000:1.0:1787784429.479210:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ee84d34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004608:0@lo:503: 00000100:00100000:1.0:1787784429.479252:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784429.479282:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000473de608 going to sleep for 11 seconds 00000100:00100000:2.0:1787784429.479302:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750004608 00000100:00100000:2.0:1787784429.479307:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750004608 00000100:00100000:2.0:1787784429.479337:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784429.479343:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072efa391 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+11:6497:x1874627750004608:12345-0@lo:503: 00000040:00080000:2.0:1787784429.479375:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784429.479420:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072efa391 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+11:6497:x1874627750004608:12345-0@lo:503: Request processed in 77us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784429.479426:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784429.479487:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ee84d34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004608:0@lo:503: 00000040:00080000:1.0:1787784429.484580:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787784429.485157:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787784429.485191:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784429.485216:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c8ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784429.485240:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c8ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784429.485299:0:6497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787784429.485302:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8951d08ed800 10000000:01000000:2.0:1787784429.485305:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8951d08ed800 10000000:01000000:2.0:1787784429.485308:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784429.485313:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951d08ed800 from 1 10000000:01000000:2.0:1787784429.485316:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787784429.485351:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784429.485359:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784429.485369:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784429.485393:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086f9dd24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004736:0@lo:101: 00000100:00100000:2.0:1787784429.485462:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784429.485510:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aed98220 going to sleep for 11 seconds 00000100:00100000:3.0:1787784429.485533:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750004736 00000100:00100000:3.0:1787784429.485542:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750004736 00000100:00100000:3.0:1787784429.485606:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784429.485614:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000671747f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+11:6497:x1874627750004736:12345-0@lo:101: 00010000:00010000:3.0:1787784429.485628:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784429.485640:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045419dd9/0x88ace7295d9c8fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c8f5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.485663:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045419dd9/0x88ace7295d9c8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c8f5 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.485673:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045419dd9/0x88ace7295d9c8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c8f5 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.485681:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045419dd9, rc 0) 00000100:00100000:3.0:1787784429.485714:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000671747f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+12:6497:x1874627750004736:12345-0@lo:101: Request processed in 102us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784429.485719:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784429.485788:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086f9dd24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004736:0@lo:101: 00010000:00010000:2.0:1787784429.485804:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c8fc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784429.485812:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c8fc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784429.485874:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086f9dd24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004864:0@lo:501: 00000100:00100000:2.0:1787784429.485916:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784429.486038:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aed98220 going to sleep for 11 seconds 00000100:00100000:3.0:1787784429.487914:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750004864 00000100:00100000:3.0:1787784429.487926:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750004864 00000100:00100000:2.0:1787784429.491519:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787784429.491533:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009195c859 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+12:6497:x1874627750004864:12345-0@lo:501: 00000100:00100000:2.0:1787784429.491720:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009195c859 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+12:6497:x1874627750004864:12345-0@lo:501: Request processed in 190us (5804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784429.491729:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787784429.491823:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086f9dd24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004864:0@lo:501: 00000100:00100000:2.0:1787784429.491881:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086f9dd24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004992:0@lo:503: 00000100:00100000:2.0:1787784429.491919:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784429.491952:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aed98220 going to sleep for 11 seconds 00000100:00100000:1.0:1787784429.492004:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750004992 00000100:00100000:1.0:1787784429.492010:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750004992 00000100:00100000:1.0:1787784429.492034:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787784429.492040:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c6b2f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+12:6497:x1874627750004992:12345-0@lo:503: 00000100:00100000:1.0:1787784429.492129:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c6b2f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+12:6497:x1874627750004992:12345-0@lo:503: Request processed in 89us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784429.492135:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787784429.492209:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086f9dd24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750004992:0@lo:503: 00000100:00100000:1.0:1787784429.499608:0:6548:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ee84d34 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:6548:1874627750005120:0@lo:502: 00000100:00100000:1.0:1787784429.499695:0:6548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784429.499892:0:6548:0:(client.c:2715:ptlrpc_set_wait()) set 000000001215cdfd going to sleep for 11 seconds 00000100:00100000:0.0:1787784429.500015:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750005120 00000100:00100000:0.0:1787784429.500023:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750005120 00000100:00100000:0.0:1787784429.500103:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784429.500123:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f4b4b16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+12:6548:x1874627750005120:12345-0@lo:502: 00000100:00100000:0.0:1787784429.500374:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f4b4b16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+12:6548:x1874627750005120:12345-0@lo:502: Request processed in 252us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784429.500383:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787784429.500463:0:6548:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ee84d34 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:6548:1874627750005120:0@lo:502: 00000020:01000004:1.0:1787784429.500524:0:6548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787784429.500537:0:6548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005878c413) 00000020:00000080:1.0:1787784429.500554:0:6548:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787784429.500651:0:6548:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000558bfd1c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787784429.500654:0:6548:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000558bfd1c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787784429.500656:0:6548:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000558bfd1c 4 00010000:00080000:1.0:1787784429.500704:0:6548:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ea37c348@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1787784429.502891:0:6548:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787784429.503122:0:6548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787784429.503158:0:6548:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787784429.503177:0:6548:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x88ace7295d9c90a 00000100:00080000:1.0:1787784429.503187:0:6548:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784429.503191:0:6548:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ea37c348 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784429.503221:0:6548:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007ee84d34 x1874627750005248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784429.503252:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ee84d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750005248:0@lo:38: 00000100:00100000:1.0:1787784429.503325:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784429.503387:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750005248 00000100:00100000:1.0:1787784429.503392:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750005248 00000100:00100000:1.0:1787784429.503426:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784429.503432:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063eb781c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874627750005248:12345-0@lo:38: 00000100:00100000:1.0:1787784429.503479:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063eb781c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874627750005248:12345-0@lo:38: Request processed in 46us (154us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787784429.503485:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784429.503513:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784429.503520:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000ea37c348 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784429.503533:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787784429.503536:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ee84d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750005248:0@lo:38: 00000100:00080000:1.0:1787784429.503551:0:6548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787784429.508329:0:6548:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ee84d34 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:6548:1874627750005376:0@lo:502: 00000100:00100000:1.0:1787784429.508558:0:6548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784429.508617:0:6548:0:(client.c:2715:ptlrpc_set_wait()) set 00000000671a9db2 going to sleep for 11 seconds 00000100:00100000:0.0:1787784429.508672:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750005376 00000100:00100000:0.0:1787784429.508680:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750005376 00000100:00100000:0.0:1787784429.508740:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784429.508749:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000741f1abe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+12:6548:x1874627750005376:12345-0@lo:502: 00000100:00100000:0.0:1787784429.509496:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000741f1abe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+12:6548:x1874627750005376:12345-0@lo:502: Request processed in 746us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784429.509505:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787784429.509609:0:6548:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ee84d34 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:6548:1874627750005376:0@lo:502: 00000040:00080000:1.0:1787784429.509642:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787784429.509802:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787784429.509827:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787784429.509844:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c8fc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784429.509856:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c8fc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787784429.510031:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787784429.510319:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787784429.510323:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784429.510325:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784429.510326:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784429.510333:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784429.510335:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784429.510337:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787784429.510338:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784429.510339:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784429.510340:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784429.510341:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784429.510345:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787784429.510347:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784429.510348:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787784429.510349:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784429.510350:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784429.510350:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784429.510351:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784429.510352:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784429.510353:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787784429.510354:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784429.510354:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784429.510355:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784429.510356:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784429.510375:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787784429.510386:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086f9dd24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750005504:0@lo:253: 00000100:00100000:2.0:1787784429.510669:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784429.510698:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbcdfe9b going to sleep for 11 seconds 00000100:00100000:0.0:1787784429.510795:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750005504 00000100:00100000:0.0:1787784429.510801:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750005504 00000100:00100000:0.0:1787784429.510840:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787784429.510847:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec68767c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+12:6497:x1874627750005504:12345-0@lo:253: 20000000:01000000:0.0:1787784429.510868:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787784429.510880:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787784429.517327:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787784429.517351:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787784429.517501:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787784429.517507:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787784429.517527:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.517551:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001695abed/0x88ace7295d9c8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c8d9 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.517558:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.517606:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001695abed/0x88ace7295d9c8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9c8d9 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.517619:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001695abed/0x88ace7295d9c8e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9c8d9 expref: 12 pid: 6516 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784429.517632:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8faf3de pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750005632:0@lo:104: 00000100:00100000:3.0:1787784429.517691:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784429.518165:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d7e719a4 going to sleep for 11 seconds 00000100:00100000:3.0:1787784429.520627:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec68767c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+12:6497:x1874627750005504:12345-0@lo:253: Request processed in 9776us (9954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784429.520640:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787784429.520743:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086f9dd24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:6497:1874627750005504:0@lo:253: 10000000:01000000:2.0:1787784429.520757:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787784429.520760:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784429.520762:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787784429.520764:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784429.520793:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784429.520794:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784429.520796:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784429.520797:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784429.520798:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787784429.520800:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784429.520800:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784429.520802:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784429.520803:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787784429.520825:0:6497:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787784429.522839:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750005632 00000100:00100000:1.0:1787784429.522853:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750005632 00000100:00100000:1.0:1787784429.522911:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784429.522920:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013eec147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:6537:x1874627750005632:12345-0@lo:104: 00010000:00010000:1.0:1787784429.522937:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c8e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.523028:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787784429.523033:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013eec147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:6537:x1874627750005632:12345-0@lo:104: Request processed in 115us (5343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784429.523052:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784429.523154:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8faf3de pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750005632:0@lo:104: 00010000:00010000:3.0:1787784429.523179:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.523282:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784429.523287:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c8e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.523294:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068d510bd already unused, calling callback (0000000051070f16) 10000000:00010000:0.0:1787784429.523298:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9c8e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.523305:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9c8e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784429.523322:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9c8e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784429.523328:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784429.523417:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c8e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.523424:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784429.523449:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c8e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.523456:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 0000000068d510bd/0x88ace7295d9c8d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c8e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784429.523473:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784429.523475:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784429.523476:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784429.524945:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000088f1c6ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750005760:0@lo:103: 00000100:00100000:0.0:1787784429.525004:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:2.0:1787784429.527178:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1787784429.527365:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787784429.527698:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1787784429.528041:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787784429.528298:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000100:00100000:1.0:1787784429.528582:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750005760 00000100:00100000:1.0:1787784429.528592:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750005760 00010000:00010000:1.0:1787784429.528626:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001695abed/0x88ace7295d9c8e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c8d9 expref: 12 pid: 6516 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784429.528669:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784429.528676:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e03b750 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+12:3645:x1874627750005760:12345-0@lo:103: 00010000:00010000:1.0:1787784429.528689:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784429.528694:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001695abed/0x88ace7295d9c8e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c8d9 expref: 12 pid: 6516 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.528705:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001695abed/0x88ace7295d9c8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9c8d9 expref: 12 pid: 6516 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.528721:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001695abed/0x88ace7295d9c8e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9c8d9 expref: 12 pid: 6516 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.528735:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.528743:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787784429.528758:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011252630s 00010000:00010000:1.0:1787784429.528762:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.528781:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.528796:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.528801:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.528806:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009da9e12c already unused, calling callback (00000000b2725807) 00010000:00010000:1.0:1787784429.528810:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.528817:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.528831:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784429.528840:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784429.528901:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e03b750 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+11:3645:x1874627750005760:12345-0@lo:103: Request processed in 225us (3897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784429.528908:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:2.0:1787784429.529043:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:3.0:1787784429.529533:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.529541:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784429.529546:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009da9e12c/0x88ace7295d9c911 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784429.530368:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000088f1c6ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750005760:0@lo:103: 00080000:10000000:1.0:1787784429.530551:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1787784429.530745:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1787784429.530961:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1787784429.531122:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1787784429.531665:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1787784429.532509:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1787784429.535321:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787784429.546319:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787784429.546816:0:6554:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787784429.548190:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787784429.548310:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787784429.548710:0:6497:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787784429.548717:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787784429.548832:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787784429.551444:0:6553:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787784429.551456:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1787784429.551539:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787784429.552513:0:6554:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784429.554313:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787784429.554383:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787784429.554633:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784429.557082:0:6554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787784429.557169:0:6554:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787784429.557174:0:6554:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:2.0:1787784429.557618:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1787784429.558543:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787784429.558695:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787784429.558853:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787784429.559018:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787784429.559142:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787784429.559409:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787784429.559547:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787784429.559709:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787784429.560046:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787784429.560170:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787784429.560384:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787784429.560508:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787784429.560651:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787784429.560852:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787784429.561009:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787784429.561146:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787784429.561503:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787784429.561671:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787784429.561946:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787784429.562096:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787784429.562317:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787784429.562483:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787784429.562662:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787784429.562882:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787784429.563021:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787784429.563172:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787784429.563406:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787784429.563554:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787784429.563724:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787784429.564120:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787784429.564340:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787784429.564482:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787784429.564710:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1787784429.567665:0:6497:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787784429.567709:0:6497:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb77a01c97988 00100000:10000000:2.0:1787784429.567725:0:6497:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787784429.568461:0:6497:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787784429.568476:0:6497:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787784429.568496:0:6497:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787784429.568510:0:6497:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787784429.569301:0:6497:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784429.569484:0:6497:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787784430.101505:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784431.113850:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784432.138716:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784433.161946:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784434.182896:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787784434.458380:0:6798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787784434.822025:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787784434.822036:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787784434.822039:0:38:0:(import.c:65:import_set_state_nolock()) 00000000ea37c348 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784434.822052:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ea37c348 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784434.822074:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000096069c1b x1874627750006016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784434.822148:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096069c1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750006016:0@lo:38: 00000100:00100000:1.0:1787784434.822281:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784434.822449:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006bca6e5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750005888:0@lo:400: 00000100:00100000:2.0:1787784434.822502:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784434.823420:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750005888 00000100:00100000:0.0:1787784434.823430:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750005888 00000100:00100000:0.0:1787784434.823474:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787784434.823482:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006891976a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+11:3646:x1874627750005888:12345-0@lo:400: 00000100:00100000:0.0:1787784434.823557:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006891976a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+11:3646:x1874627750005888:12345-0@lo:400: Request processed in 76us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784434.823565:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787784434.823634:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006bca6e5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750005888:0@lo:400: 00000100:00100000:0.0:1787784434.826701:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750006016 00000100:00100000:0.0:1787784434.826718:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750006016 00000100:00100000:0.0:1787784434.826804:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784434.826811:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ee84d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874627750006016:12345-0@lo:38: 00010000:00080000:0.0:1787784434.826842:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:0.0:1787784434.826881:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x88ace7295d9c918 00000004:00100000:0.0:1787784434.826929:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787784434.827039:0:6523:0:(import.c:65:import_set_state_nolock()) 00000000f168f508 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784434.828223:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ee84d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874627750006016:12345-0@lo:38: Request processed in 1405us (5937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784434.828235:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787784434.830335:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000096069c1b x1874627750006016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787784434.830359:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787784434.830368:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787784434.830373:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787784434.830377:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000ea37c348 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787784434.830384:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096069c1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750006016:0@lo:38: 00010000:00010000:1.0:1787784435.211967:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787784435.502279:0:6851:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784435.502467:0:6851:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787784436.230050:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784437.255889:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784438.280668:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787784438.527539:0:6952:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787784438.527762:0:6952:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1787784438.917882:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787784438.917891:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951d08ed800 from 3 10000000:01000000:3.0:1787784438.917897:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787784438.917943:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784438.917955:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784438.917965:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784438.917988:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8faf3de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750006144:0@lo:101: 00000100:00100000:3.0:1787784438.918064:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784438.918139:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 000000007367f256 going to sleep for 11 seconds 00000100:00100000:0.0:1787784438.918457:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750006144 00000100:00100000:0.0:1787784438.918465:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750006144 00000100:00100000:0.0:1787784438.918576:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787784438.918584:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a8f165a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+11:6518:x1874627750006144:12345-0@lo:101: 00010000:00010000:0.0:1787784438.918597:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784438.918609:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e23911d4/0x88ace7295d9c926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c91f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784438.918631:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e23911d4/0x88ace7295d9c926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c91f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784438.918640:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e23911d4/0x88ace7295d9c926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c91f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784438.918669:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e23911d4, rc 0) 00000100:00100000:0.0:1787784438.918723:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a8f165a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+12:6518:x1874627750006144:12345-0@lo:101: Request processed in 139us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784438.918730:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784438.918961:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8faf3de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750006144:0@lo:101: 00010000:00010000:3.0:1787784438.918976:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c926 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784438.918994:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c926 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784438.919059:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8faf3de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750006272:0@lo:256: 00000100:00100000:3.0:1787784438.919091:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784438.919120:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 000000007367f256 going to sleep for 11 seconds 00000100:00100000:2.0:1787784438.919315:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750006272 00000100:00100000:2.0:1787784438.919320:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750006272 00000100:00100000:2.0:1787784438.919383:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784438.919390:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c7666bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+12:6518:x1874627750006272:12345-0@lo:256: 20000000:01000000:2.0:1787784438.919404:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787784438.919422:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787784438.919424:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787784438.919517:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c7666bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+12:6518:x1874627750006272:12345-0@lo:256: Request processed in 128us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784438.919525:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787784438.919603:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8faf3de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750006272:0@lo:256: 10000000:01000000:1.0:1787784438.919649:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787784438.919656:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c926 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784438.919663:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c926 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784439.302152:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784439.953112:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f9696a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750006528:0@lo:400: 00000100:00100000:1.0:1787784439.953200:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784439.953293:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750006528 00000100:00100000:1.0:1787784439.953301:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750006528 00000100:00100000:1.0:1787784439.953356:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784439.953364:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020037021 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750006528:12345-0@lo:400: 00000100:00100000:1.0:1787784439.953415:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020037021 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750006528:12345-0@lo:400: Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784439.953422:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787784439.953459:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007f9696a4 x1874627750006528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784439.953482:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f9696a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750006528:0@lo:400: 00000100:00100000:0.0:1787784439.953649:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750006400:0@lo:400: 00000100:00100000:0.0:1787784439.953683:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784439.961174:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750006400 00000100:00100000:1.0:1787784439.961188:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750006400 00000100:00100000:1.0:1787784439.961342:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787784439.961352:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef2b346d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+12:3647:x1874627750006400:12345-0@lo:400: 00000100:00100000:1.0:1787784439.961452:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef2b346d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+12:3647:x1874627750006400:12345-0@lo:400: Request processed in 102us (7768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784439.961459:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787784439.963707:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750006400:0@lo:400: 00010000:00010000:0.0:1787784440.329328:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784441.349924:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784442.383820:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784443.404883:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784444.421863:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784445.062293:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784445.063951:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784445.064004:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b3f34aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750006656:0@lo:400: 00000100:00100000:0.0:1787784445.067595:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003fd31a9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750006784:0@lo:400: 00000100:00100000:0.0:1787784445.067687:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784445.067893:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784445.068038:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750006656 00000100:00100000:3.0:1787784445.068054:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750006656 00000100:00100000:2.0:1787784445.068203:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787784445.068226:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000faeddd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+12:3644:x1874627750006656:12345-0@lo:400: 00000100:00100000:0.0:1787784445.068796:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b3f34aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750006656:0@lo:400: 00000100:00100000:2.0:1787784445.068871:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000faeddd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+12:3644:x1874627750006656:12345-0@lo:400: Request processed in 95us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784445.068881:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784445.069823:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750006784 00000100:00100000:1.0:1787784445.069839:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750006784 00000100:00100000:1.0:1787784445.069916:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784445.069927:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031c8fe2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750006784:12345-0@lo:400: 00000100:00100000:1.0:1787784445.070061:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031c8fe2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750006784:12345-0@lo:400: Request processed in 137us (2375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784445.070102:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787784445.070739:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003fd31a9f x1874627750006784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784445.070759:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003fd31a9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750006784:0@lo:400: 00010000:00010000:1.0:1787784445.448675:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784446.471004:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784447.494595:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784448.527799:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784449.544177:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787784449.627594:0:7450:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787784449.627600:0:7450:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787784449.627601:0:7450:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787784449.627728:0:7450:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000fb5a6225 00000020:01000004:0.0:1787784449.627747:0:7450:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1787784449.627758:0:7450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787784449.627827:0:7450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000f75cf52e) 00000020:00000080:0.0:1787784449.627846:0:7450:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787784449.697272:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1787784449.697355:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1787784449.729920:0:7450:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787784449.730303:0:7450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787784449.730313:0:7450:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787784449.730325:0:7450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9c934 00000020:01000004:3.0:1787784449.730331:0:7450:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787784449.730352:0:7450:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787784449.730355:0:7450:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787784449.730360:0:7450:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787784449.730396:0:7450:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787784449.730400:0:7450:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787784449.762849:0:7450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787784449.762889:0:7450:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.141@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1787784449.762894:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787784449.762896:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787784449.762897:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784449.762899:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784449.762900:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784449.762900:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784449.762901:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784449.762902:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784449.762904:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784449.762905:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784449.762906:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784449.762909:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1787784449.762912:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784449.762913:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787784449.762914:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784449.762915:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784449.762916:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784449.762917:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784449.762918:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784449.762919:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784449.762920:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784449.762921:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784449.762922:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784449.762950:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787784449.762969:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f80ab49d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750006912:0@lo:253: 00000100:00100000:2.0:1787784449.763051:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784449.763111:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964b0e22 going to sleep for 11 seconds 00000100:00100000:0.0:1787784449.763133:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750006912 00000100:00100000:0.0:1787784449.763158:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750006912 00000100:00100000:0.0:1787784449.763216:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784449.763223:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096537323 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+12:7450:x1874627750006912:12345-0@lo:253: 20000000:01000000:0.0:1787784449.763255:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787784449.763259:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1787784449.763264:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1787784449.763267:0:6516:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1787784449.763297:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1787784449.763488:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787784449.763619:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787784449.763633:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787784449.763648:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1787784449.763661:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1787784449.763675:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1787784449.763726:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1787784449.763734:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1787784449.763747:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1787784449.763753:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1787784449.763764:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1787784449.763846:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1787784449.763862:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1787784449.763875:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1787784449.763972:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1787784449.763981:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:0.0:1787784449.763994:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1787784449.764000:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787784449.764013:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1787784449.764018:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:0.0:1787784449.764029:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1787784449.764045:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787784449.764061:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1787784449.764089:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1787784449.764098:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787784449.764193:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1787784449.764202:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1787784449.764213:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1787784449.764229:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1787784449.764244:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1787784449.764250:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1787784449.764264:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1787784449.764285:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1787784449.764291:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1787784449.764313:0:6516:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787784449.764320:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1787784449.766378:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1787784449.766742:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787784449.766948:0:6516:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.141@tcp for mdt 20000000:01000000:2.0:1787784449.766951:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:2.0:1787784449.766979:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787784449.766997:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787784449.767009:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787784449.767013:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:2.0:1787784449.767027:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787784449.767033:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1787784449.767047:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1787784449.767061:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1787784449.767124:0:6516:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1787784449.767133:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1787784449.767958:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1787784449.768146:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787784449.768169:0:6516:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.141@tcp for mdt 20000000:01000000:2.0:1787784449.768172:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:2.0:1787784449.768202:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787784449.768210:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787784449.768221:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787784449.768226:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:2.0:1787784449.768236:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787784449.768242:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1787784449.768253:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787784449.768265:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1787784449.768284:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787784449.768287:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787784449.768291:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787784449.768345:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787784449.768347:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787784449.768761:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787784449.768811:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787784449.768826:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1787784449.769510:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787784449.769555:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787784449.769576:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1787784449.769589:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787784449.769591:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787784449.786837:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1787784449.786894:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1787784449.786910:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787784449.787257:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787784449.787279:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787784449.787301:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787784449.787312:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787784449.787314:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787784449.788416:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787784449.788456:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787784449.788471:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787784449.788660:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1787784449.788682:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1787784449.788698:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1787784449.788715:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787784449.788718:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787784449.788724:0:6516:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787784449.788731:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787784449.789366:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1787784449.789489:0:6516:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787784449.805233:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787784449.805264:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.805286:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000de3f49dc/0x88ace7295d9c870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c869 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.805293:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c88c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c885 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.805300:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000045419dd9/0x88ace7295d9c8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c8f5 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.805326:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.805367:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000045419dd9/0x88ace7295d9c8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9c8f5 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.805396:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000045419dd9/0x88ace7295d9c8fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9c8f5 expref: 12 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784449.805413:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dfa0dd6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750007040:0@lo:104: 00000100:00100000:1.0:1787784449.805480:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784449.805534:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c88c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9c885 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.805541:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c88c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9c885 expref: 12 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784449.805548:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064cb3ec8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750007168:0@lo:104: 00000100:00100000:1.0:1787784449.805568:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784449.805820:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000de3f49dc/0x88ace7295d9c870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9c869 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.805828:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000de3f49dc/0x88ace7295d9c870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9c869 expref: 12 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784449.805836:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750007296:0@lo:104: 00000100:00100000:1.0:1787784449.805858:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784449.817983:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1d7e381 going to sleep for 11 seconds 00000100:00100000:0.0:1787784449.818312:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750007040 00000100:00100000:0.0:1787784449.818323:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750007040 00000100:00100000:0.0:1787784449.818372:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750007168 00000100:00100000:0.0:1787784449.818375:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750007168 00000100:00100000:0.0:1787784449.818397:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750007296 00000100:00100000:0.0:1787784449.818401:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750007296 00000100:00100000:0.0:1787784449.818417:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784449.818425:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4c07be8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+5:6516:x1874627750007040:12345-0@lo:104: 00010000:00010000:0.0:1787784449.818442:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c8fc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.818550:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784449.818556:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4c07be8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+5:6516:x1874627750007040:12345-0@lo:104: Request processed in 132us (13076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784449.818564:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784449.818582:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784449.818588:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa16f154 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:6516:x1874627750007168:12345-0@lo:104: 00010000:00010000:0.0:1787784449.818595:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c88c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.818633:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787784449.818638:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa16f154 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:6516:x1874627750007168:12345-0@lo:104: Request processed in 52us (13070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784449.818643:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784449.818656:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784449.818662:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f9696a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:6516:x1874627750007296:12345-0@lo:104: 00010000:00010000:0.0:1787784449.818668:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c870 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.818694:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787784449.818697:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f9696a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:6516:x1874627750007296:12345-0@lo:104: Request processed in 37us (12840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784449.818703:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784449.818831:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dfa0dd6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750007040:0@lo:104: 00000100:00100000:1.0:1787784449.818850:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064cb3ec8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750007168:0@lo:104: 00000100:00100000:1.0:1787784449.818856:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750007296:0@lo:104: 00010000:00010000:1.0:1787784449.818882:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819358:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787784449.819365:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c8fc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819373:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad0185e0 already unused, calling callback (0000000051070f16) 10000000:00010000:1.0:1787784449.819376:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9c8fc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819394:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9c8fc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784449.819401:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9c8fc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784449.819406:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784449.819441:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c8fc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819448:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784449.819465:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c8fc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819471:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 00000000ad0185e0/0x88ace7295d9c8f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c8fc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819498:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784449.819500:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c88c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819505:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ddf30866 already unused, calling callback (0000000051070f16) 10000000:00010000:1.0:1787784449.819507:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9c88c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819512:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9c88c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784449.819518:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9c88c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784449.819522:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784449.819534:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c88c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819540:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784449.819552:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c88c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819558:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c88c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819566:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784449.819568:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c870 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819585:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000543e0fd3 already unused, calling callback (0000000051070f16) 10000000:00010000:1.0:1787784449.819588:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9c870 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819593:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9c870 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784449.819597:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9c870 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784449.819602:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784449.819615:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c870 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819621:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784449.819626:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c870 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819631:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 00000000543e0fd3/0x88ace7295d9c869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c870 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819644:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784449.819646:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784449.819647:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784449.819667:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dfa0dd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750007680:0@lo:103: 00000100:00100000:1.0:1787784449.819712:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784449.819749:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784449.819755:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064cb3ec8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750007552:0@lo:103: 00000100:00100000:1.0:1787784449.819810:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784449.819846:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750007680 00000100:00100000:1.0:1787784449.819851:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750007680 00010000:00010000:1.0:1787784449.819874:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000de3f49dc/0x88ace7295d9c870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c869 expref: 13 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784449.819896:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750007552 00000100:00100000:1.0:1787784449.819900:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750007552 00010000:00010000:1.0:1787784449.819909:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c88c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c885 expref: 14 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784449.819922:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784449.819929:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006ba4f1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+14:3645:x1874627750007680:12345-0@lo:103: 00010000:00010000:1.0:1787784449.819939:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784449.819943:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000de3f49dc/0x88ace7295d9c870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c869 expref: 14 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819951:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000de3f49dc/0x88ace7295d9c870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9c869 expref: 14 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819965:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000de3f49dc/0x88ace7295d9c870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9c869 expref: 14 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.819977:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784449.820005:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006ba4f1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+13:3645:x1874627750007680:12345-0@lo:103: Request processed in 78us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784449.820013:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784449.820026:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784449.820032:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c0ed091 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+12:3645:x1874627750007552:12345-0@lo:103: 00010000:00010000:1.0:1787784449.820119:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784449.820129:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c88c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c885 expref: 12 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.820137:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c88c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9c885 expref: 12 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.820249:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c88c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9c885 expref: 12 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.820260:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784449.820284:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c0ed091 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+11:3645:x1874627750007552:12345-0@lo:103: Request processed in 253us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784449.820291:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784449.820321:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064cb3ec8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750007552:0@lo:103: 00000100:00100000:1.0:1787784449.820328:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dfa0dd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750007680:0@lo:103: 00010000:00010000:3.0:1787784449.820552:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784449.820558:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784449.820567:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750007424:0@lo:103: 00000100:00100000:3.0:1787784449.820606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.820638:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750007424 00000100:00100000:3.0:1787784449.820642:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750007424 00010000:00010000:3.0:1787784449.820655:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000045419dd9/0x88ace7295d9c8fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c8f5 expref: 11 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784449.820684:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784449.820691:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6c23aa4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+11:3646:x1874627750007424:12345-0@lo:103: 00010000:00010000:3.0:1787784449.820699:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784449.820702:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000045419dd9/0x88ace7295d9c8fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c8f5 expref: 11 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.820710:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000045419dd9/0x88ace7295d9c8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9c8f5 expref: 11 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.820723:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000045419dd9/0x88ace7295d9c8fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9c8f5 expref: 11 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.820733:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.820740:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.820753:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.820783:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.820790:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.820867:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.820874:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000005b887c5 already unused, calling callback (00000000b2725807) 00010000:00010000:3.0:1787784449.820877:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.820883:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.820901:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.820909:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784449.820935:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6c23aa4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+10:3646:x1874627750007424:12345-0@lo:103: Request processed in 245us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784449.820940:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784449.820961:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750007424:0@lo:103: 00010000:00010000:1.0:1787784449.821123:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.821132:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.821137:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000005b887c5/0x88ace7295d9c93b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787784449.821283:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787784449.825860:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096537323 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+9:7450:x1874627750006912:12345-0@lo:253: Request processed in 62630us (62802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784449.825875:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787784449.825920:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f80ab49d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750006912:0@lo:253: 10000000:01000000:2.0:1787784449.825936:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787784449.825939:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784449.825941:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787784449.825953:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784449.825955:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1787784449.825956:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784449.825958:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784449.825959:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784449.825960:0:7450:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787784449.825962:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784449.825963:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787784449.826052:0:7450:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fb5a6225 from lustre-MDT0001 10000000:01000000:2.0:1787784449.826082:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787784449.826084:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787784449.826090:0:7450:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8951cfef0000 local copy 10000000:01000000:2.0:1787784449.826094:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787784449.826126:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784449.826136:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784449.826144:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784449.826160:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f80ab49d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750007808:0@lo:101: 00000100:00100000:2.0:1787784449.829542:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784449.829631:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 0000000083b19765 going to sleep for 11 seconds 00000100:00100000:0.0:1787784449.829690:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750007808 00000100:00100000:0.0:1787784449.829699:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750007808 00000100:00100000:0.0:1787784449.830026:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787784449.830047:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc511a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+9:7450:x1874627750007808:12345-0@lo:101: 00010000:00010000:0.0:1787784449.830079:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784449.830094:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045b908b4/0x88ace7295d9c949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c942 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.830121:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045b908b4/0x88ace7295d9c949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c942 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.830132:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045b908b4/0x88ace7295d9c949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c942 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.830140:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045b908b4, rc 0) 00000100:00100000:0.0:1787784449.830350:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc511a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+10:7450:x1874627750007808:12345-0@lo:101: Request processed in 316us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784449.830358:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784449.830559:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f80ab49d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750007808:0@lo:101: 00010000:00010000:3.0:1787784449.830577:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x88ace7295d9c949 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.830587:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x88ace7295d9c949 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784449.830701:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750007936:0@lo:501: 00000100:00100000:3.0:1787784449.830733:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.830849:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021c37b25 going to sleep for 11 seconds 00000100:00100000:0.0:1787784449.830901:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750007936 00000100:00100000:0.0:1787784449.830906:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750007936 00000100:00100000:0.0:1787784449.830929:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787784449.830935:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe1a1462 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+10:7450:x1874627750007936:12345-0@lo:501: 00000100:00100000:0.0:1787784449.830999:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe1a1462 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+10:7450:x1874627750007936:12345-0@lo:501: Request processed in 64us (266us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787784449.831007:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787784449.831125:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750007936:0@lo:501: 10000000:01000000:3.0:1787784449.831140:0:7450:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787784449.831283:0:7450:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787784449.831288:0:7450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x88ace7295d9c949 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.831296:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x88ace7295d9c949 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.831302:0:7450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x88ace7295d9c949 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.831324:0:7450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787784449.831345:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8951cfe95800 10000000:01000000:3.0:1787784449.831349:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787784449.831353:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8951cfef0000 10000000:01000000:3.0:1787784449.831356:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787784449.831359:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8951cfef0000 from 1 10000000:01000000:3.0:1787784449.831361:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787784449.831393:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000009da9e12c/0x88ace7295d9c950 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.831399:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000009da9e12c/0x88ace7295d9c950 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.831417:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000009da9e12c/0x88ace7295d9c950 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784449.831428:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008064:0@lo:101: 00000100:00100000:3.0:1787784449.831453:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.831467:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000695ed346 going to sleep for 11 seconds 00000100:00100000:2.0:1787784449.831569:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750008064 00000100:00100000:2.0:1787784449.831573:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750008064 00000100:00100000:2.0:1787784449.831595:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787784449.831601:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d05ee1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+10:7450:x1874627750008064:12345-0@lo:101: 00010000:00010000:2.0:1787784449.831609:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784449.831618:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a7207629/0x88ace7295d9c957 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c950 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784449.831647:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7207629/0x88ace7295d9c957 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c950 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784449.831654:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a7207629/0x88ace7295d9c957 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c950 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784449.831660:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a7207629, rc 0) 00000100:00100000:2.0:1787784449.831688:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d05ee1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+11:7450:x1874627750008064:12345-0@lo:101: Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784449.831694:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787784449.831795:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008064:0@lo:101: 00010000:00010000:3.0:1787784449.831806:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000009da9e12c/0x88ace7295d9c950 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c957 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.831812:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000009da9e12c/0x88ace7295d9c950 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c957 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784449.831826:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787784449.831833:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 000000009da9e12c/0x88ace7295d9c950 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c957 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.831839:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 000000009da9e12c/0x88ace7295d9c950 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c957 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784449.831846:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8951cfe95800 10000000:01000000:3.0:1787784449.831850:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787784449.831853:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8951cfe95800 from 1 10000000:01000000:3.0:1787784449.831854:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787784449.831868:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000494fa2fd/0x88ace7295d9c95e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.831874:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000494fa2fd/0x88ace7295d9c95e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.831887:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000494fa2fd/0x88ace7295d9c95e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784449.831898:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008192:0@lo:101: 00000100:00100000:3.0:1787784449.831923:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.831941:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000695ed346 going to sleep for 11 seconds 00000100:00100000:2.0:1787784449.831990:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750008192 00000100:00100000:2.0:1787784449.831995:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750008192 00000100:00100000:2.0:1787784449.832012:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787784449.832017:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2f8dba6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+11:7450:x1874627750008192:12345-0@lo:101: 00010000:00010000:2.0:1787784449.832023:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784449.832030:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c61f613c/0x88ace7295d9c965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c95e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784449.832054:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c61f613c/0x88ace7295d9c965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c95e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784449.832061:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c61f613c/0x88ace7295d9c965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c95e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784449.832067:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c61f613c, rc 0) 00000100:00100000:2.0:1787784449.832103:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2f8dba6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+12:7450:x1874627750008192:12345-0@lo:101: Request processed in 86us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784449.832110:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787784449.832416:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008192:0@lo:101: 00010000:00010000:3.0:1787784449.832426:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000494fa2fd/0x88ace7295d9c95e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.832433:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000494fa2fd/0x88ace7295d9c95e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784449.832443:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787784449.832450:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000494fa2fd/0x88ace7295d9c95e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.832455:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000494fa2fd/0x88ace7295d9c95e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784449.832461:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787784449.832465:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784449.832469:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8951cfe95800 10000000:01000000:3.0:1787784449.832471:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787784449.832474:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787784449.832476:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787784449.832486:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000050c10b6a/0x88ace7295d9c96c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.832504:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000050c10b6a/0x88ace7295d9c96c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.832510:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000050c10b6a/0x88ace7295d9c96c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784449.832520:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008320:0@lo:101: 00000100:00100000:3.0:1787784449.832545:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.832555:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000695ed346 going to sleep for 11 seconds 00000100:00100000:2.0:1787784449.832608:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750008320 00000100:00100000:2.0:1787784449.832613:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750008320 00000100:00100000:2.0:1787784449.832632:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787784449.832638:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fa3d428 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+12:7450:x1874627750008320:12345-0@lo:101: 00010000:00010000:2.0:1787784449.832644:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784449.832653:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003482a36a/0x88ace7295d9c973 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c96c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784449.832666:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003482a36a/0x88ace7295d9c973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c96c expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784449.832673:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003482a36a/0x88ace7295d9c973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c96c expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784449.832679:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003482a36a, rc 0) 00000100:00100000:2.0:1787784449.832713:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fa3d428 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+13:7450:x1874627750008320:12345-0@lo:101: Request processed in 76us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784449.832719:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787784449.832813:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008320:0@lo:101: 00010000:00010000:3.0:1787784449.832823:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000050c10b6a/0x88ace7295d9c96c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c973 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.832829:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000050c10b6a/0x88ace7295d9c96c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c973 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784449.832898:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008448:0@lo:501: 00000100:00100000:3.0:1787784449.832921:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.832936:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000695ed346 going to sleep for 11 seconds 00000100:00100000:2.0:1787784449.832986:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750008448 00000100:00100000:2.0:1787784449.832990:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750008448 00000100:00100000:2.0:1787784449.833008:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787784449.833013:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a231dd7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+13:7450:x1874627750008448:12345-0@lo:501: 00000100:00100000:2.0:1787784449.833125:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a231dd7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+13:7450:x1874627750008448:12345-0@lo:501: Request processed in 112us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784449.833133:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787784449.833533:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008448:0@lo:501: 00000100:00100000:3.0:1787784449.833563:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008576:0@lo:503: 00000100:00100000:3.0:1787784449.833607:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.833616:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000695ed346 going to sleep for 11 seconds 00000100:00100000:2.0:1787784449.833653:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750008576 00000100:00100000:2.0:1787784449.833657:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750008576 00000100:00100000:2.0:1787784449.833676:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787784449.833682:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3ac3207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+13:7450:x1874627750008576:12345-0@lo:503: 00000100:00100000:2.0:1787784449.833800:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3ac3207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+13:7450:x1874627750008576:12345-0@lo:503: Request processed in 118us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784449.833808:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787784449.833917:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008576:0@lo:503: 00000040:00080000:3.0:1787784449.834420:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784449.834509:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008704:0@lo:502: 00000100:00100000:3.0:1787784449.834556:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.834584:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000695ed346 going to sleep for 11 seconds 00000100:00100000:2.0:1787784449.834673:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750008704 00000100:00100000:2.0:1787784449.834679:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750008704 00000100:00100000:2.0:1787784449.834702:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787784449.834709:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da1464fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+13:7450:x1874627750008704:12345-0@lo:502: 00000100:00100000:2.0:1787784449.834831:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da1464fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+13:7450:x1874627750008704:12345-0@lo:502: Request processed in 122us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784449.834839:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784449.834946:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008704:0@lo:502: 00000040:00080000:3.0:1787784449.835874:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787784449.835909:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1787784449.835924:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1787784449.835937:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1787784449.835950:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1787784449.835963:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1787784449.835975:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1787784449.835988:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1787784449.836003:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1787784449.836015:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1787784449.836027:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1787784449.836110:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1787784449.836124:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1787784449.836137:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1787784449.836316:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1787784449.836338:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1787784449.836353:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1787784449.836366:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1787784449.836393:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1787784449.836409:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1787784449.836422:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1787784449.836435:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1787784449.836449:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1787784449.836487:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008832:0@lo:502: 00000100:00100000:3.0:1787784449.836556:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.836589:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000695ed346 going to sleep for 11 seconds 00000100:00100000:1.0:1787784449.836699:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750008832 00000100:00100000:1.0:1787784449.836708:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750008832 00010000:00010000:1.0:1787784449.836729:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784449.836735:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x88ace7295d9c949 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.836745:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030af295c already unused, calling callback (0000000051070f16) 10000000:00010000:1.0:1787784449.836748:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x88ace7295d9c949 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.836756:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x88ace7295d9c949 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784449.836762:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x88ace7295d9c949 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784449.836791:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784449.836816:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x88ace7295d9c949 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.836823:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784449.836848:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x88ace7295d9c949 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.836854:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 0000000030af295c/0x88ace7295d9c942 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x88ace7295d9c949 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.836868:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784449.836870:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784449.836871:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784449.836878:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784449.836891:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dfa0dd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750008960:0@lo:103: 00000100:00100000:1.0:1787784449.836921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784449.836956:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750008960 00000100:00100000:1.0:1787784449.836960:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750008960 00000100:00100000:1.0:1787784449.836999:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784449.837006:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064cb3ec8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+14:3647:x1874627750008960:12345-0@lo:103: 00010000:00010000:1.0:1787784449.837019:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784449.837032:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000045b908b4/0x88ace7295d9c949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9c942 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.837058:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784449.837089:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064cb3ec8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+13:3647:x1874627750008960:12345-0@lo:103: Request processed in 83us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784449.837095:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784449.837127:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dfa0dd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750008960:0@lo:103: 00000100:00100000:1.0:1787784449.837461:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787784449.837469:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cec7bd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+12:7450:x1874627750008832:12345-0@lo:502: 00000100:00100000:1.0:1787784449.837583:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cec7bd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+12:7450:x1874627750008832:12345-0@lo:502: Request processed in 115us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784449.837590:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787784449.837861:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750008832:0@lo:502: 00000040:00080000:3.0:1787784449.837933:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1787784449.837945:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1787784449.839010:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784449.839022:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784449.839025:0:7463:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787784449.839030:0:7463:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787784449.839033:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784449.839119:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000ff5ba43a) 00000020:00000080:1.0:1787784449.839140:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1787784449.839287:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787784449.839361:0:7463:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787784449.839368:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9c981 00000020:00000080:1.0:1787784449.839612:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787784449.839624:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784449.839628:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784449.839629:0:7463:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787784449.839632:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784449.839636:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784449.839637:0:7463:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787784449.839640:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784449.839647:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000009e6534e7) 00000020:00000080:1.0:1787784449.839658:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1787784449.839662:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787784449.839663:0:7463:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787784449.839666:0:7463:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787784449.839672:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787784449.839728:0:7463:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fb5a6225 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787784449.839749:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000004ae948f0) 00000020:00000080:1.0:1787784449.839760:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1787784449.839907:0:7463:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787784449.839913:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9c996 00000020:00000080:1.0:1787784449.840017:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787784449.840025:0:7463:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787784449.840030:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x88ace7295d9c99d 00080000:01000000:1.0:1787784449.840113:0:7463:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787784449.840118:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9c9a4 00080000:10000000:1.0:1787784449.840728:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787784449.840955:0:7463:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1787784449.904675:0:7463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1787784449.904935:0:7463:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1787784449.906663:0:7463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787784449.907101:0:7463:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787784449.914089:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1787784449.914104:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784449.914109:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784449.914111:0:7463:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787784449.914113:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784449.914119:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784449.914120:0:7463:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787784449.914121:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787784449.914129:0:7463:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:00000080:0.0:1787784449.914151:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784449.914162:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000063f446cf) 00000020:00000080:0.0:1787784449.914180:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787784449.914183:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787784449.914231:0:7463:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787784449.914236:0:7463:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787784449.914239:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9c9b2 00010000:00080000:0.0:1787784449.914261:0:7463:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d3db2497@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1787784449.916574:0:7463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1787784449.918375:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787784449.918402:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787784449.918442:0:7463:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787784449.918464:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9c9b9 00000100:00080000:2.0:1787784449.918476:0:7463:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784449.918481:0:7463:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000d3db2497 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784449.918518:0:7463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000899281ca x1874627750009088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784449.918550:0:7463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787784449.918651:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784449.918655:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784449.918656:0:7463:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787784449.918659:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787784449.918662:0:7463:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787784449.918663:0:7463:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787784449.918664:0:7463:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787784449.918671:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787784449.918673:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784449.918675:0:7463:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787784449.918677:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784449.918681:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784449.918683:0:7463:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787784449.918686:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787784449.918716:0:7463:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787784449.918730:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784449.918733:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784449.918734:0:7463:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787784449.918736:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784449.918738:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784449.918740:0:7463:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784449.918743:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784449.918744:0:7463:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787784449.918795:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784449.918799:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784449.918800:0:7463:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787784449.918803:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1787784449.918957:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000899281ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750009088:0@lo:38: 00000100:00100000:0.0:1787784449.919046:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784449.919222:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750009088 00000100:00100000:2.0:1787784449.919230:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750009088 00000100:00100000:2.0:1787784449.919269:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784449.919276:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b3f34aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750009088:12345-0@lo:38: 00010000:00080000:2.0:1787784449.919298:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1787784449.919326:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9c9c0 00000004:00100000:2.0:1787784449.919341:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787784449.919346:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787784449.919560:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750009216:0@lo:400: 00000100:00100000:0.0:1787784449.919592:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784449.919651:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750009216 00000100:00100000:2.0:1787784449.919655:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750009216 00000100:00100000:2.0:1787784449.919686:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784449.919691:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088f1c6ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750009216:12345-0@lo:400: 00000020:01000000:3.0:1787784449.919789:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1787784449.919821:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787784449.919835:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000050c10b6a/0x88ace7295d9c96c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c973 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.919845:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000050c10b6a/0x88ace7295d9c96c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c973 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784449.919852:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951cfe95800 from 1 10000000:01000000:3.0:1787784449.919855:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787784449.919879:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.919886:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.919893:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784449.919907:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750009344:0@lo:101: 00000100:00100000:3.0:1787784449.919939:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.919961:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040845ba7 going to sleep for 11 seconds 00000100:00100000:1.0:1787784449.920243:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750009344 00000100:00100000:1.0:1787784449.920250:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750009344 00000100:00100000:1.0:1787784449.920277:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787784449.920283:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026e03fc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+12:7450:x1874627750009344:12345-0@lo:101: 00010000:00010000:1.0:1787784449.920292:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784449.920302:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000005b887c5/0x88ace7295d9c9ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c9c7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.920399:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005b887c5/0x88ace7295d9c9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c9c7 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.920410:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000005b887c5/0x88ace7295d9c9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c9c7 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.920418:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000005b887c5, rc 0) 00000100:00100000:1.0:1787784449.920457:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026e03fc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+13:7450:x1874627750009344:12345-0@lo:101: Request processed in 174us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784449.920479:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750009344:0@lo:101: 00010000:00010000:3.0:1787784449.920493:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c9ce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.920511:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c9ce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784449.920524:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787784449.920974:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750009472:0@lo:256: 00000100:00100000:3.0:1787784449.921009:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.921107:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040845ba7 going to sleep for 11 seconds 00000100:00100000:2.0:1787784449.922176:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088f1c6ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750009216:12345-0@lo:400: Request processed in 2480us (2579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784449.922186:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784449.922231:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750009472 00000100:00100000:2.0:1787784449.922237:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750009472 00000100:00100000:2.0:1787784449.922262:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787784449.922267:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000010eb934 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+13:7450:x1874627750009472:12345-0@lo:256: 20000000:01000000:2.0:1787784449.922282:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787784449.922297:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787784449.922299:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787784449.922424:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000010eb934 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+13:7450:x1874627750009472:12345-0@lo:256: Request processed in 156us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784449.922429:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787784449.923327:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000620249be x1874627750009216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784449.923345:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000620249be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750009216:0@lo:400: 00000100:00100000:3.0:1787784449.923754:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750009472:0@lo:256: 10000000:01000000:3.0:1787784449.924284:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787784449.924299:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c9ce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.924307:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c9ce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784449.924312:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951cfe95800 from 1 10000000:01000000:3.0:1787784449.924314:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784449.924343:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.924349:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.924357:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784449.924372:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750009600:0@lo:101: 00000100:00100000:3.0:1787784449.924425:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.924468:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040845ba7 going to sleep for 11 seconds 00000100:00100000:1.0:1787784449.924480:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750009600 00000100:00100000:1.0:1787784449.924486:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750009600 00000100:00100000:1.0:1787784449.924522:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787784449.924528:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b677fca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+13:7450:x1874627750009600:12345-0@lo:101: 00010000:00010000:1.0:1787784449.924540:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784449.924550:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c9dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c9d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.924572:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c9dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c9d5 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.924582:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c9dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c9d5 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.924590:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008c4b4de5, rc 0) 00000100:00100000:1.0:1787784449.924629:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b677fca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+14:7450:x1874627750009600:12345-0@lo:101: Request processed in 101us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784449.924635:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787784449.924636:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750009600:0@lo:101: 00010000:00010000:3.0:1787784449.924646:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c9dc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.924653:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c9dc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784449.924743:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750009728:0@lo:501: 00000100:00100000:3.0:1787784449.924787:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.924800:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040845ba7 going to sleep for 11 seconds 00000100:00100000:1.0:1787784449.924810:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750009728 00000100:00100000:1.0:1787784449.924814:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750009728 00000100:00100000:1.0:1787784449.924834:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784449.924839:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ef96978 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+14:7450:x1874627750009728:12345-0@lo:501: 00000100:00100000:1.0:1787784449.924932:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ef96978 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+14:7450:x1874627750009728:12345-0@lo:501: Request processed in 93us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784449.924939:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787784449.924946:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750009728:0@lo:501: 00000100:00100000:3.0:1787784449.924970:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750009856:0@lo:503: 00000100:00100000:3.0:1787784449.925009:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.925028:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040845ba7 going to sleep for 11 seconds 00000100:00100000:1.0:1787784449.925119:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750009856 00000100:00100000:1.0:1787784449.925123:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750009856 00000100:00100000:1.0:1787784449.925143:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787784449.925148:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fe2e9d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+14:7450:x1874627750009856:12345-0@lo:503: 00000040:00080000:1.0:1787784449.925177:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787784449.925217:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fe2e9d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+14:7450:x1874627750009856:12345-0@lo:503: Request processed in 69us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784449.925222:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750009856:0@lo:503: 00000100:00100000:1.0:1787784449.925224:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000040:00080000:3.0:1787784449.925665:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784449.925709:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1787784449.926661:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1787784449.927660:0:6526:0:(import.c:65:import_set_state_nolock()) 000000000788b1d3 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784449.927734:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b3f34aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1874627750009088:12345-0@lo:38: Request processed in 8456us (8698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784449.927748:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784449.927816:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787784449.927825:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787784449.927833:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787784449.927838:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787784449.927840:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000d3db2497 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787784449.927851:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000899281ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750009088:0@lo:38: 00000100:00100000:0.0:1787784449.927906:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e268f5fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750009984:0@lo:41: 00000040:00080000:3.0:1787784449.927914:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000100:00100000:0.0:1787784449.927944:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787784449.927959:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787784449.927983:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784449.927997:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c9dc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784449.928002:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750009984 00000100:00100000:0.0:1787784449.928007:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750009984 00010000:00010000:3.0:1787784449.928008:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c9dc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784449.928035:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784449.928042:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e325e34a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874627750009984:12345-0@lo:41: 00000004:00000024:0.0:1787784449.928066:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1787784449.928116:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e325e34a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874627750009984:12345-0@lo:41: Request processed in 74us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784449.928122:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784449.928150:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e268f5fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750009984:0@lo:41: 10000000:01000000:3.0:1787784449.928260:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787784449.928263:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8951cfe95800 10000000:01000000:3.0:1787784449.928266:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8951cfe95800 10000000:01000000:3.0:1787784449.928269:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784449.928275:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951cfe95800 from 1 10000000:01000000:3.0:1787784449.928277:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787784449.928301:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.928308:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.928316:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784449.928329:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750010112:0@lo:101: 00000100:00100000:3.0:1787784449.928360:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.928436:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a027263c going to sleep for 11 seconds 00000100:00100000:1.0:1787784449.928527:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750010112 00000100:00100000:1.0:1787784449.928531:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750010112 00000100:00100000:1.0:1787784449.928571:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787784449.928578:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004af617fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+14:7450:x1874627750010112:12345-0@lo:101: 00010000:00010000:1.0:1787784449.928587:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784449.928599:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de3f49dc/0x88ace7295d9c9ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9c9e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.928620:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de3f49dc/0x88ace7295d9c9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9c9e3 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.928629:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de3f49dc/0x88ace7295d9c9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c9e3 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.928648:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de3f49dc, rc 0) 00000100:00100000:1.0:1787784449.928728:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004af617fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:7450:x1874627750010112:12345-0@lo:101: Request processed in 151us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784449.928732:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787784449.928845:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750010112:0@lo:101: 00010000:00010000:3.0:1787784449.928858:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c9e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c9ea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.928866:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c9e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c9ea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784449.928938:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750010240:0@lo:501: 00000100:00100000:3.0:1787784449.928959:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.928987:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a027263c going to sleep for 11 seconds 00000100:00100000:1.0:1787784449.929059:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750010240 00000100:00100000:1.0:1787784449.929064:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750010240 00000100:00100000:1.0:1787784449.929096:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787784449.929103:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074c1488f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:7450:x1874627750010240:12345-0@lo:501: 00000100:00100000:1.0:1787784449.929188:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074c1488f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:7450:x1874627750010240:12345-0@lo:501: Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784449.929195:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787784449.929213:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750010240:0@lo:501: 00000100:00100000:3.0:1787784449.929237:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750010368:0@lo:503: 00000100:00100000:3.0:1787784449.929270:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.929287:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a027263c going to sleep for 11 seconds 00000100:00100000:1.0:1787784449.929305:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750010368 00000100:00100000:1.0:1787784449.929308:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750010368 00000100:00100000:1.0:1787784449.929395:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787784449.929402:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b203dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:7450:x1874627750010368:12345-0@lo:503: 00000100:00100000:3.0:1787784449.929493:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750010368:0@lo:503: 00000100:00100000:1.0:1787784449.929537:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b203dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:7450:x1874627750010368:12345-0@lo:503: Request processed in 136us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784449.929544:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000040:00080000:3.0:1787784449.929737:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784449.929825:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750010496:0@lo:502: 00000100:00100000:3.0:1787784449.929860:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.929878:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a027263c going to sleep for 11 seconds 00000100:00100000:1.0:1787784449.929901:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750010496 00000100:00100000:1.0:1787784449.929905:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750010496 00000100:00100000:1.0:1787784449.929931:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787784449.929937:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4a622ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:7450:x1874627750010496:12345-0@lo:502: 00000100:00100000:1.0:1787784449.930064:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4a622ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:7450:x1874627750010496:12345-0@lo:502: Request processed in 127us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784449.930070:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787784449.930125:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750010496:0@lo:502: 00000040:00080000:3.0:1787784449.930241:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787784449.930259:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787784449.930266:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787784449.930273:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787784449.930280:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787784449.930286:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787784449.930293:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787784449.930310:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787784449.930317:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787784449.930326:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787784449.930338:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787784449.930350:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787784449.930362:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787784449.930375:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787784449.930547:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787784449.930555:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787784449.930562:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787784449.930568:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787784449.930582:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787784449.930589:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787784449.930596:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787784449.930602:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787784449.930609:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787784449.930623:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787784449.930631:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787784449.930637:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787784449.930643:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787784449.930649:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1787784449.930663:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750010624:0@lo:502: 00000100:00100000:3.0:1787784449.930687:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.930712:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a027263c going to sleep for 11 seconds 00000100:00100000:1.0:1787784449.930729:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750010624 00000100:00100000:1.0:1787784449.930738:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750010624 00000100:00100000:1.0:1787784449.930764:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787784449.930807:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b196926b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:7450:x1874627750010624:12345-0@lo:502: 00000100:00100000:1.0:1787784449.930882:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b196926b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:7450:x1874627750010624:12345-0@lo:502: Request processed in 85us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784449.930888:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787784449.930900:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750010624:0@lo:502: 00000040:00080000:3.0:1787784449.930933:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787784449.930940:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787784449.931349:0:7469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787784449.931371:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000212854ca) 00000020:00000080:3.0:1787784449.931403:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787784449.931476:0:7469:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fb5a6225 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787784449.931480:0:7469:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000fb5a6225 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787784449.931482:0:7469:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000fb5a6225 3 00010000:00080000:3.0:1787784449.931517:0:7469:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000079299178@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1787784449.932821:0:7469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1787784449.933010:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787784449.933044:0:7469:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787784449.933054:0:7469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x88ace7295d9c9f8 00000100:00080000:3.0:1787784449.933062:0:7469:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787784449.933067:0:7469:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000079299178 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784449.933096:0:7469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ef47fabb x1874627750010752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784449.933119:0:7469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1787784449.933270:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1787784449.933367:0:7470:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1787784449.933554:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874627750010752:0@lo:38: 00000100:00100000:0.0:1787784449.933627:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787784449.933758:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787784449.933816:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787784449.933828:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c9e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c9ea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784449.933838:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000ddf30866/0x88ace7295d9c9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c9ea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787784449.933879:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787784449.933881:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787784449.933882:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784449.933884:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784449.933885:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784449.933886:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784449.933887:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787784449.933888:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787784449.933890:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787784449.933891:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784449.933892:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784449.933896:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1787784449.933898:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787784449.933900:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787784449.933901:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784449.933902:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784449.933903:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784449.933905:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784449.933906:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787784449.933906:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787784449.933907:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787784449.933912:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784449.933913:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784449.933931:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787784449.933941:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dfa0dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750010880:0@lo:253: 00000100:00100000:1.0:1787784449.933975:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784449.933996:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d8f78b1a going to sleep for 11 seconds 00000100:00100000:1.0:1787784449.934014:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750010880 00000100:00100000:1.0:1787784449.934020:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750010880 00000100:00100000:1.0:1787784449.934130:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787784449.934138:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000465b3a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:7450:x1874627750010880:12345-0@lo:253: 20000000:01000000:1.0:1787784449.934161:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787784449.934173:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1787784449.935505:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787784449.935591:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787784449.935611:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787784449.935795:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787784449.935800:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787784449.935820:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.935836:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e23911d4/0x88ace7295d9c926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c91f expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.935844:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000005b887c5/0x88ace7295d9c9ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c9c7 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.935851:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.935881:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000005b887c5/0x88ace7295d9c9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9c9c7 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.935906:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000005b887c5/0x88ace7295d9c9ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9c9c7 expref: 15 pid: 6516 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784449.935919:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000089139807 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750011008:0@lo:104: 00000100:00100000:0.0:1787784449.935970:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784449.936009:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e23911d4/0x88ace7295d9c926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9c91f expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.936017:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e23911d4/0x88ace7295d9c926 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9c91f expref: 15 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784449.936025:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750011136:0@lo:104: 00000100:00100000:1.0:1787784449.936194:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000465b3a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:7450:x1874627750010880:12345-0@lo:253: Request processed in 2056us (2218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784449.936203:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787784449.936261:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dfa0dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:7450:1874627750010880:0@lo:253: 10000000:01000000:1.0:1787784449.936273:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787784449.936275:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787784449.936277:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787784449.936278:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784449.936279:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784449.936280:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784449.936281:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784449.936282:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787784449.936283:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787784449.936284:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787784449.936286:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784449.936287:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787784449.936299:0:7450:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787784449.939483:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750010752 00000100:00100000:3.0:1787784449.939494:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750010752 00000100:00100000:3.0:1787784449.939533:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784449.939540:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e268f5fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874627750010752:12345-0@lo:38: 00010000:00080000:3.0:1787784449.939569:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1787784449.939621:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x88ace7295d9ca06 00000004:00100000:3.0:1787784449.939639:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787784449.939670:0:6523:0:(import.c:65:import_set_state_nolock()) 00000000bc086ef8 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784449.939753:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e268f5fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874627750010752:12345-0@lo:38: Request processed in 213us (6127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784449.939760:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787784449.939827:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ef47fabb x1874627750010752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784449.939839:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787784449.939848:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787784449.939855:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787784449.939859:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787784449.939863:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000079299178 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787784449.939868:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874627750010752:0@lo:38: 00000100:00100000:0.0:1787784449.939989:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784449.940038:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c96c9053 going to sleep for 11 seconds 00000100:00100000:0.0:1787784449.940056:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750011008 00000100:00100000:0.0:1787784449.940062:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750011008 00000100:00100000:0.0:1787784449.940085:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750011136 00000100:00100000:0.0:1787784449.940087:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750011136 00000100:00100000:0.0:1787784449.940097:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784449.940102:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000309cda16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:6537:x1874627750011008:12345-0@lo:104: 00010000:00010000:0.0:1787784449.940116:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c9ce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940158:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784449.940162:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000309cda16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:6537:x1874627750011008:12345-0@lo:104: Request processed in 61us (4194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784449.940168:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784449.940182:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784449.940194:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc76ac1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:6537:x1874627750011136:12345-0@lo:104: 00010000:00010000:0.0:1787784449.940201:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c926 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940234:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787784449.940237:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc76ac1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:6537:x1874627750011136:12345-0@lo:104: Request processed in 45us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784449.940243:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787784449.940258:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784449.940263:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c9ce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940270:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000045419dd9 already unused, calling callback (0000000051070f16) 10000000:00010000:0.0:1787784449.940274:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9c9ce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940281:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9c9ce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784449.940288:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9c9ce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784449.940293:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784449.940323:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c9ce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940330:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784449.940349:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c9ce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940365:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 0000000045419dd9/0x88ace7295d9c9c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c9ce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940392:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784449.940394:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c926 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940399:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001ed302db already unused, calling callback (0000000051070f16) 10000000:00010000:0.0:1787784449.940401:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9c926 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940407:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9c926 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784449.940412:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9c926 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784449.940417:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784449.940429:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c926 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940435:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784449.940450:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c926 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940455:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 000000001ed302db/0x88ace7295d9c91f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c926 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940468:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784449.940479:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784449.940481:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784449.940495:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008cb31d35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750011264:0@lo:103: 00000100:00100000:0.0:1787784449.940529:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784449.940559:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b54138b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750011392:0@lo:103: 00000100:00100000:0.0:1787784449.940584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784449.940618:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750011264 00000100:00100000:0.0:1787784449.940621:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750011264 00010000:00010000:0.0:1787784449.940637:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000005b887c5/0x88ace7295d9c9ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c9c7 expref: 15 pid: 6516 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784449.940654:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750011392 00000100:00100000:0.0:1787784449.940657:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750011392 00010000:00010000:0.0:1787784449.940666:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e23911d4/0x88ace7295d9c926 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c91f expref: 16 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784449.940676:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784449.940681:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000220e7a63 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+16:3645:x1874627750011264:12345-0@lo:103: 00010000:00010000:0.0:1787784449.940689:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784449.940693:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000005b887c5/0x88ace7295d9c9ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c9c7 expref: 16 pid: 6516 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940701:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000005b887c5/0x88ace7295d9c9ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9c9c7 expref: 16 pid: 6516 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940716:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784449.940740:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000220e7a63 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+16:3645:x1874627750011264:12345-0@lo:103: Request processed in 60us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784449.940746:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784449.940757:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784449.940807:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025f3dd2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+15:3646:x1874627750011392:12345-0@lo:103: 00010000:00010000:0.0:1787784449.940815:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784449.940818:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e23911d4/0x88ace7295d9c926 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c91f expref: 15 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940826:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e23911d4/0x88ace7295d9c926 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9c91f expref: 15 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940837:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940844:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787784449.940857:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011252630s 00010000:00010000:0.0:1787784449.940861:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940867:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940872:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940877:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940881:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000045b908b4 already unused, calling callback (00000000b2725807) 00010000:00010000:0.0:1787784449.940884:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940890:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940903:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.940912:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784449.940940:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025f3dd2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+15:3646:x1874627750011392:12345-0@lo:103: Request processed in 135us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784449.940946:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784449.941015:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b54138b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750011392:0@lo:103: 00000100:00100000:0.0:1787784449.941036:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008cb31d35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750011264:0@lo:103: 00010000:00010000:0.0:1787784449.941053:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000005b887c5/0x88ace7295d9c9ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9c9c7 expref: 14 pid: 6516 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784449.941064:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000089139807 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750011008:0@lo:104: 00010000:00010000:0.0:1787784449.941073:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e23911d4/0x88ace7295d9c926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9c91f expref: 13 pid: 6514 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784449.941080:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750011136:0@lo:104: 00010000:00010000:0.0:1787784449.941091:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.941098:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.941102:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784449.941108:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000045b908b4/0x88ace7295d9c9ff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784449.941311:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787784449.942538:0:7450:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1787784449.942717:0:7450:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787784449.943127:0:7450:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787784449.943325:0:7450:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787784449.943547:0:7450:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787784449.943708:0:7450:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1787784449.946131:0:7450:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787784449.946405:0:7450:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1787784449.946599:0:7450:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1787784449.946796:0:7450:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1787784449.946981:0:7450:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1787784449.947173:0:7450:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1787784449.951463:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1787784449.951754:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1787784449.951878:0:7475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a00eb4d2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1874627750011520:0@lo:700: 00000100:00100000:2.0:1787784449.951965:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784449.952030:0:7475:0:(client.c:2715:ptlrpc_set_wait()) set 00000000967d6f7e going to sleep for 11 seconds 00000040:01000000:1.0:1787784449.952307:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787784449.952434:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750011520 00000100:00100000:3.0:1787784449.952442:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750011520 00000100:00100000:3.0:1787784449.952501:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784449.952509:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073d1e7be pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1874627750011520:12345-0@lo:700: 00000100:00100000:3.0:1787784449.953465:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874627750011648:0@lo:1000: 00000100:00100000:3.0:1787784449.953529:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.953567:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 000000003520c3d8 going to sleep for 11 seconds 00000040:01000000:1.0:1787784449.954373:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:2.0:1787784449.954925:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750011648 00000100:00100000:2.0:1787784449.954935:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750011648 00000100:00100000:2.0:1787784449.955173:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784449.955182:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c96625d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874627750011648:12345-0@lo:1000: 00000100:00100000:2.0:1787784449.955281:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c96625d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874627750011648:12345-0@lo:1000: Request processed in 100us (1751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784449.955289:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:00080000:0.0:1787784449.955363:0:7474:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787784449.955368:0:7474:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:1.0:1787784449.955493:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784449.956232:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874627750011648:0@lo:1000: 00000040:01000000:3.0:1787784449.956269:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1787784449.956309:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874627750011776:0@lo:700: 00000100:00100000:3.0:1787784449.956352:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.956404:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750011776 00000100:00100000:3.0:1787784449.956409:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750011776 00000100:00100000:3.0:1787784449.956446:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784449.956453:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074237788 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874627750011776:12345-0@lo:700: 00000100:00100000:3.0:1787784449.956495:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074237788 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874627750011776:12345-0@lo:700: Request processed in 42us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784449.956502:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784449.956524:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a027263c going to sleep for 11 seconds 00000100:00100000:3.0:1787784449.956538:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874627750011776:0@lo:700: 00000100:00100000:3.0:1787784449.956582:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1874627750011904:0@lo:900: 00000100:00100000:3.0:1787784449.956606:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.956633:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750011904 00000100:00100000:3.0:1787784449.956636:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750011904 00000100:00100000:3.0:1787784449.956657:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784449.956662:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8faf3de pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1874627750011904:12345-0@lo:900: 00000100:00100000:3.0:1787784449.956691:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8faf3de pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1874627750011904:12345-0@lo:900: Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784449.956709:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784449.956739:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a027263c going to sleep for 11 seconds 00010000:00080000:3.0:1787784449.956754:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ef47fabb x1874627750011904/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787784465 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784449.956764:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1874627750011904:0@lo:900: 00000100:00100000:3.0:1787784449.956906:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874627750012032:0@lo:1000: 00000100:00100000:3.0:1787784449.956930:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.956953:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750012032 00000100:00100000:3.0:1787784449.956956:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750012032 00000100:00100000:3.0:1787784449.956971:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784449.956976:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096069c1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874627750012032:12345-0@lo:1000: 00000100:00100000:3.0:1787784449.957016:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096069c1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874627750012032:12345-0@lo:1000: Request processed in 40us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784449.957022:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00000080:1.0:1787784449.957300:0:7450:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787784449.957312:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:3.0:1787784449.957623:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000517f866e going to sleep for 11 seconds 00000100:00100000:3.0:1787784449.957640:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874627750012032:0@lo:1000: 00000004:00080000:3.0:1787784449.957677:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000a027263c with version 0 00000020:00100000:3.0:1787784449.957691:0:7476:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787784449.957695:0:7476:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ef47fabb x1874627750012288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784449.957708:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874627750012288:0@lo:1000: 00000100:00100000:3.0:1787784449.957734:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784449.957757:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750012288 00000100:00100000:3.0:1787784449.957760:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750012288 00000100:00100000:3.0:1787784449.957867:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784449.957880:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006bca6e5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874627750012288:12345-0@lo:1000: 00000040:00080000:1.0:1787784449.958136:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784449.958965:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964b0e22 going to sleep for 11 seconds 00000040:00080000:1.0:1787784449.961150:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000001:00080000:3.0:1787784449.962736:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1787784449.963020:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006bca6e5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874627750012288:12345-0@lo:1000: Request processed in 5136us (5280us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787784449.963146:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 40000000:02000000:3.0:1787784449.963209:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:1.0:1787784449.964681:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787784449.964758:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1787784449.966302:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787784449.966553:0:7450:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787784449.968589:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000004:00080000:2.0:1787784449.969189:0:7476:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1787784449.969195:0:7476:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787784449.969213:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874627750012288:0@lo:1000: 00000100:00100000:2.0:1787784449.969307:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e1ebd84 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874627750012416:0@lo:1000: 00000100:00100000:2.0:1787784449.969368:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784449.969430:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d7f083c5 going to sleep for 11 seconds 00000100:00100000:0.0:1787784449.969492:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750012416 00000100:00100000:0.0:1787784449.969499:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750012416 00000100:00100000:0.0:1787784449.969549:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784449.969557:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a4eb71f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874627750012416:12345-0@lo:1000: 00000100:00100000:0.0:1787784449.969636:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a4eb71f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874627750012416:12345-0@lo:1000: Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784449.969643:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784449.969713:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e1ebd84 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874627750012416:0@lo:1000: 00000040:00080000:2.0:1787784449.969730:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787784449.969758:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000075a4184 with version 1 00000004:00080000:0.0:1787784449.969895:0:7465:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000a0d2ce85 version 1 rpc_version 1 00000020:00100000:0.0:1787784449.969912:0:7465:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787784449.969919:0:7465:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e77d7015 x1874627750012672/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784449.969934:0:7465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1874627750012672:0@lo:1000: 00000100:00100000:0.0:1787784449.969975:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784449.969993:0:7465:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd9e7005 going to sleep for 11 seconds 00000100:00100000:0.0:1787784449.970005:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750012672 00000100:00100000:0.0:1787784449.970008:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750012672 00000100:00100000:0.0:1787784449.970031:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787784449.970037:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089139807 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1874627750012672:12345-0@lo:1000: 00100000:10000000:1.0:1787784449.971953:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787784449.972228:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787784449.972401:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787784449.972557:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000100:00100000:3.0:1787784449.976138:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073d1e7be pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1874627750011520:12345-0@lo:700: Request processed in 23623us (24166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784449.976155:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787784449.976640:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a00eb4d2 x1874627750011520/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787784465 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784449.976658:0:7475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a00eb4d2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1874627750011520:0@lo:700: 40000000:02000000:0.0:1787784449.976681:0:7475:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000040:00080000:2.0:1787784449.978741:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787784449.978861:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:1.0:1787784449.980324:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787784449.980670:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787784449.980853:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787784449.981035:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787784449.981220:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787784449.981375:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787784449.981531:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787784449.981697:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787784449.981863:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787784449.982001:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787784449.982129:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787784449.982439:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787784449.982577:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787784449.982740:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787784449.982887:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787784449.983024:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787784449.983132:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787784449.983260:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000001:00080000:3.0:1787784449.986622:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1787784449.988278:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089139807 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1874627750012672:12345-0@lo:1000: Request processed in 18233us (18295us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787784449.988293:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1787784449.988409:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787784449.988415:0:7465:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787784449.988433:0:7465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1874627750012672:0@lo:1000: 00100000:10000000:1.0:1787784449.988718:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787784449.989432:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787784449.989592:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787784449.989735:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787784449.992558:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787784449.998363:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787784449.998567:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787784449.998711:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787784449.999192:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787784449.999422:0:7450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787784450.009660:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787784450.010067:0:7450:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787784450.010099:0:7450:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb77a01977988 00100000:10000000:1.0:1787784450.010108:0:7450:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1787784450.011599:0:7450:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787784450.011636:0:7450:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787784450.011659:0:7450:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787784450.011677:0:7450:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787784450.012707:0:7450:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787784450.012944:0:7450:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1787784450.031961:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787784450.032050:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1787784450.032055:0:7475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1787784450.567744:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784451.594485:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784452.613971:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784453.639691:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784454.663229:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787784455.074659:0:7720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787784455.301995:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000220e7a63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750012928:0@lo:400: 00000100:00100000:0.0:1787784455.302075:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784455.302189:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750012928 00000100:00100000:0.0:1787784455.302197:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750012928 00000100:00100000:0.0:1787784455.302250:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784455.302260:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cb31d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750012928:12345-0@lo:400: 00000100:00100000:0.0:1787784455.302317:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cb31d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750012928:12345-0@lo:400: Request processed in 59us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784455.302324:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787784455.302374:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000220e7a63 x1874627750012928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784455.302389:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000220e7a63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750012928:0@lo:400: 00000100:00100000:0.0:1787784455.302425:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000220e7a63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750013056:0@lo:400: 00000100:00100000:0.0:1787784455.302451:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784455.302486:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750013056 00000100:00100000:0.0:1787784455.302490:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750013056 00000100:00100000:0.0:1787784455.302513:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784455.302519:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fd31a9f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750013056:12345-0@lo:400: 00000100:00100000:0.0:1787784455.302556:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fd31a9f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750013056:12345-0@lo:400: Request processed in 38us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784455.302562:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784455.302589:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000220e7a63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750013056:0@lo:400: 00000100:00100000:1.0:1787784455.302722:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e03b750 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750012800:0@lo:400: 00000100:00100000:1.0:1787784455.302754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784455.302805:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784455.302811:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000220e7a63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750013184:0@lo:400: 00000100:00100000:1.0:1787784455.302837:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784455.302929:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750012800 00000100:00100000:0.0:1787784455.302947:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750012800 00000100:00100000:0.0:1787784455.302973:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787784455.302979:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a942f7b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+13:3647:x1874627750012800:12345-0@lo:400: 00000100:00100000:0.0:1787784455.303014:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a942f7b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+13:3647:x1874627750012800:12345-0@lo:400: Request processed in 37us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784455.303020:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787784455.303101:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750013312:0@lo:41: 00000100:00100000:1.0:1787784455.303141:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784455.303168:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e03b750 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750012800:0@lo:400: 00000100:00100000:0.0:1787784455.303255:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750013312 00000100:00100000:0.0:1787784455.303259:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750013312 00000100:00100000:0.0:1787784455.303288:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784455.303294:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c0ed091 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750013312:12345-0@lo:41: 00000004:00000024:0.0:1787784455.303319:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1787784455.303365:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c0ed091 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750013312:12345-0@lo:41: Request processed in 71us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784455.303371:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784455.303501:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750013184 00000100:00100000:3.0:1787784455.303505:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750013184 00000100:00100000:3.0:1787784455.303537:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784455.303543:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dfa0dd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750013184:12345-0@lo:400: 00000100:00100000:3.0:1787784455.303576:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dfa0dd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750013184:12345-0@lo:400: Request processed in 33us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784455.303582:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784455.303677:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750013312:0@lo:41: 00010000:00080000:1.0:1787784455.303689:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000220e7a63 x1874627750013184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784455.303697:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000220e7a63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750013184:0@lo:400: 00010000:00010000:3.0:1787784455.686863:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787784456.274246:0:7772:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787784456.274489:0:7772:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787784456.710554:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784457.733968:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787784458.374076:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787784458.374084:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951cfe95800 from 4 10000000:01000000:0.0:1787784458.374089:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787784458.374138:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000e23911d4/0x88ace7295d9ca0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.374151:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000e23911d4/0x88ace7295d9ca0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.374163:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000e23911d4/0x88ace7295d9ca0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784458.374189:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b54138b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750013440:0@lo:101: 00000100:00100000:0.0:1787784458.374260:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784458.374400:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 000000003011bafd going to sleep for 11 seconds 00000100:00100000:1.0:1787784458.374566:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750013440 00000100:00100000:1.0:1787784458.374574:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750013440 00000100:00100000:1.0:1787784458.374631:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787784458.374639:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a575423 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+13:6518:x1874627750013440:12345-0@lo:101: 00010000:00010000:1.0:1787784458.374653:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784458.375119:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000d73ca1c/0x88ace7295d9ca14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ca0d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.375156:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000d73ca1c/0x88ace7295d9ca14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ca0d expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.375167:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000d73ca1c/0x88ace7295d9ca14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca0d expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.375176:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000d73ca1c, rc 0) 00000100:00100000:1.0:1787784458.375223:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a575423 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+14:6518:x1874627750013440:12345-0@lo:101: Request processed in 586us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784458.375229:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784458.375453:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b54138b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750013440:0@lo:101: 00010000:00010000:0.0:1787784458.375469:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000e23911d4/0x88ace7295d9ca0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca14 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.375477:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000e23911d4/0x88ace7295d9ca0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ca14 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784458.375530:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b54138b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750013568:0@lo:256: 00000100:00100000:0.0:1787784458.375564:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784458.375645:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 000000003011bafd going to sleep for 11 seconds 00000100:00100000:2.0:1787784458.375979:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750013568 00000100:00100000:2.0:1787784458.375986:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750013568 00000100:00100000:2.0:1787784458.376069:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787784458.376077:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049de8f03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+14:6518:x1874627750013568:12345-0@lo:256: 20000000:01000000:2.0:1787784458.376094:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787784458.376110:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787784458.376113:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787784458.376209:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049de8f03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+14:6518:x1874627750013568:12345-0@lo:256: Request processed in 133us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784458.376217:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787784458.376285:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b54138b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750013568:0@lo:256: 10000000:01000000:1.0:1787784458.376337:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787784458.376345:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000e23911d4/0x88ace7295d9ca0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca14 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.376353:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000e23911d4/0x88ace7295d9ca0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca14 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784458.376363:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787784458.376365:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951d08ed800 from 21 10000000:01000000:1.0:1787784458.376368:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787784458.376389:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000f18b5314/0x88ace7295d9ca1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.376396:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000f18b5314/0x88ace7295d9ca1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.376403:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000f18b5314/0x88ace7295d9ca1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784458.376423:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750013696:0@lo:101: 00000100:00100000:1.0:1787784458.376451:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784458.376579:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f8980c6 going to sleep for 11 seconds 00000100:00100000:0.0:1787784458.376671:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750013696 00000100:00100000:0.0:1787784458.376676:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750013696 00000100:00100000:0.0:1787784458.376710:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787784458.376717:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d576caa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+14:6518:x1874627750013696:12345-0@lo:101: 00010000:00010000:0.0:1787784458.376724:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784458.376734:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000543e0fd3/0x88ace7295d9ca22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ca1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.376749:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000543e0fd3/0x88ace7295d9ca22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ca1b expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.376756:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000543e0fd3/0x88ace7295d9ca22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca1b expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.376763:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000543e0fd3, rc 0) 00000100:00100000:0.0:1787784458.376826:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d576caa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750013696:12345-0@lo:101: Request processed in 110us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784458.376832:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787784458.376965:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750013696:0@lo:101: 00010000:00010000:1.0:1787784458.376973:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000f18b5314/0x88ace7295d9ca1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca22 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.376978:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000f18b5314/0x88ace7295d9ca1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ca22 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784458.377033:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750013824:0@lo:501: 00000100:00100000:1.0:1787784458.377051:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784458.377070:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f8980c6 going to sleep for 11 seconds 00000100:00100000:0.0:1787784458.377106:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750013824 00000100:00100000:0.0:1787784458.377115:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750013824 00000100:00100000:0.0:1787784458.377132:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787784458.377137:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059ff6d5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750013824:12345-0@lo:501: 00000100:00100000:0.0:1787784458.377237:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059ff6d5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750013824:12345-0@lo:501: Request processed in 100us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784458.377242:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787784458.377300:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750013824:0@lo:501: 00000100:00100000:1.0:1787784458.377338:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750013952:0@lo:503: 00000100:00100000:1.0:1787784458.377373:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784458.377395:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f8980c6 going to sleep for 11 seconds 00000100:00100000:0.0:1787784458.377440:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750013952 00000100:00100000:0.0:1787784458.377444:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750013952 00000100:00100000:0.0:1787784458.377461:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787784458.377465:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3dd42a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750013952:12345-0@lo:503: 00000100:00100000:0.0:1787784458.377548:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3dd42a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750013952:12345-0@lo:503: Request processed in 82us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784458.377555:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787784458.378162:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750013952:0@lo:503: 00000100:00100000:1.0:1787784458.378702:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:7825:1874627750014080:0@lo:502: 00000100:00100000:1.0:1787784458.378747:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784458.378806:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000944d73ee going to sleep for 11 seconds 00000100:00100000:0.0:1787784458.378952:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750014080 00000100:00100000:0.0:1787784458.378958:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750014080 00000100:00100000:0.0:1787784458.378984:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787784458.378992:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a31ad778 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:7825:x1874627750014080:12345-0@lo:502: 00000100:00100000:0.0:1787784458.379100:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a31ad778 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:7825:x1874627750014080:12345-0@lo:502: Request processed in 109us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784458.379108:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787784458.379554:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:7825:1874627750014080:0@lo:502: 00000100:00100000:1.0:1787784458.379598:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:7825:1874627750014208:0@lo:502: 00000100:00100000:1.0:1787784458.379639:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784458.379666:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000944d73ee going to sleep for 11 seconds 00000100:00100000:0.0:1787784458.379845:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750014208 00000100:00100000:0.0:1787784458.379850:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750014208 00000100:00100000:0.0:1787784458.379880:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787784458.379886:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f48faa74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:7825:x1874627750014208:12345-0@lo:502: 00000100:00100000:0.0:1787784458.379953:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f48faa74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:7825:x1874627750014208:12345-0@lo:502: Request processed in 67us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784458.379960:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787784458.380083:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:7825:1874627750014208:0@lo:502: 00000040:00080000:1.0:1787784458.380100:0:7825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787784458.380312:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787784458.380336:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787784458.380344:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000f18b5314/0x88ace7295d9ca1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca22 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.380352:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000f18b5314/0x88ace7295d9ca1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca22 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784458.380360:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787784458.380363:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951d08ed800 from 4 10000000:01000000:0.0:1787784458.380366:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787784458.380388:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000e658a979/0x88ace7295d9ca29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.380394:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000e658a979/0x88ace7295d9ca29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.380401:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000e658a979/0x88ace7295d9ca29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784458.380412:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750014336:0@lo:101: 00000100:00100000:0.0:1787784458.380439:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784458.380466:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f89e5650 going to sleep for 11 seconds 00000100:00100000:1.0:1787784458.380511:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750014336 00000100:00100000:1.0:1787784458.380516:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750014336 00000100:00100000:1.0:1787784458.380536:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787784458.380541:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d452c364 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750014336:12345-0@lo:101: 00010000:00010000:1.0:1787784458.380550:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784458.380560:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000142acb7b/0x88ace7295d9ca30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ca29 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.380580:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000142acb7b/0x88ace7295d9ca30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ca29 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.380589:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000142acb7b/0x88ace7295d9ca30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca29 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.380597:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000142acb7b, rc 0) 00000100:00100000:1.0:1787784458.380632:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d452c364 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750014336:12345-0@lo:101: Request processed in 92us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784458.380639:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787784458.380983:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750014336:0@lo:101: 00010000:00010000:0.0:1787784458.380996:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000e658a979/0x88ace7295d9ca29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca30 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.381003:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000e658a979/0x88ace7295d9ca29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ca30 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784458.381055:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750014464:0@lo:256: 00000100:00100000:0.0:1787784458.381084:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784458.381108:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f89e5650 going to sleep for 11 seconds 00000100:00100000:1.0:1787784458.381149:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750014464 00000100:00100000:1.0:1787784458.381153:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750014464 00000100:00100000:1.0:1787784458.381170:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787784458.381173:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7c74a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750014464:12345-0@lo:256: 20000000:01000000:1.0:1787784458.381183:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787784458.381196:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787784458.381201:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787784458.381259:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7c74a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750014464:12345-0@lo:256: Request processed in 86us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784458.381264:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787784458.381806:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750014464:0@lo:256: 10000000:01000000:0.0:1787784458.381844:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787784458.381850:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000e658a979/0x88ace7295d9ca29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca30 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.381990:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000e658a979/0x88ace7295d9ca29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca30 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784458.381998:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787784458.382000:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787784458.382002:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787784458.382021:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000001695abed/0x88ace7295d9ca37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.382027:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000001695abed/0x88ace7295d9ca37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.382034:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000001695abed/0x88ace7295d9ca37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784458.382046:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750014592:0@lo:101: 00000100:00100000:0.0:1787784458.382074:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784458.382102:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f89e5650 going to sleep for 11 seconds 00000100:00100000:1.0:1787784458.382146:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750014592 00000100:00100000:1.0:1787784458.382150:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750014592 00000100:00100000:1.0:1787784458.382171:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787784458.382176:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d825919f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750014592:12345-0@lo:101: 00010000:00010000:1.0:1787784458.382184:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784458.382193:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000019cc38b3/0x88ace7295d9ca3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ca37 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.382208:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019cc38b3/0x88ace7295d9ca3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ca37 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.382216:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000019cc38b3/0x88ace7295d9ca3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca37 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.382222:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000019cc38b3, rc 0) 00000100:00100000:1.0:1787784458.382259:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d825919f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750014592:12345-0@lo:101: Request processed in 83us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784458.382265:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787784458.382399:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750014592:0@lo:101: 00010000:00010000:0.0:1787784458.382416:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000001695abed/0x88ace7295d9ca37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca3e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784458.382424:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000001695abed/0x88ace7295d9ca37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ca3e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784458.382473:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750014720:0@lo:501: 00000100:00100000:0.0:1787784458.382497:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784458.382517:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f89e5650 going to sleep for 11 seconds 00000100:00100000:1.0:1787784458.382559:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750014720 00000100:00100000:1.0:1787784458.382563:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750014720 00000100:00100000:1.0:1787784458.382580:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787784458.382585:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000552d221b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750014720:12345-0@lo:501: 00000100:00100000:1.0:1787784458.382702:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000552d221b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750014720:12345-0@lo:501: Request processed in 116us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784458.382708:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787784458.383110:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750014720:0@lo:501: 00000100:00100000:0.0:1787784458.383151:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750014848:0@lo:503: 00000100:00100000:0.0:1787784458.383188:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784458.383211:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f89e5650 going to sleep for 11 seconds 00000100:00100000:1.0:1787784458.383280:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750014848 00000100:00100000:1.0:1787784458.383285:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750014848 00000100:00100000:1.0:1787784458.383314:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787784458.383320:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f469fa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750014848:12345-0@lo:503: 00000100:00100000:1.0:1787784458.383397:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f469fa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750014848:12345-0@lo:503: Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784458.383416:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787784458.383585:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750014848:0@lo:503: 00000100:00100000:0.0:1787784458.384260:0:7826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:7826:1874627750014976:0@lo:502: 00000100:00100000:0.0:1787784458.384321:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784458.384353:0:7826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000000a92a64 going to sleep for 11 seconds 00000100:00100000:1.0:1787784458.384449:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750014976 00000100:00100000:1.0:1787784458.384454:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750014976 00000100:00100000:1.0:1787784458.384492:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787784458.384500:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000003ef400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:7826:x1874627750014976:12345-0@lo:502: 00000100:00100000:1.0:1787784458.384595:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000003ef400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:7826:x1874627750014976:12345-0@lo:502: Request processed in 96us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784458.384602:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787784458.384720:0:7826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:7826:1874627750014976:0@lo:502: 00000020:01000000:0.0:1787784458.384745:0:7826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784458.384759:0:7826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784458.384761:0:7826:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787784458.384800:0:7826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787784458.384804:0:7826:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:00000080:0.0:1787784458.384830:0:7826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784458.384845:0:7826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000039cd7241) 00000020:00000080:0.0:1787784458.385430:0:7826:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1787784458.385453:0:7826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787784458.385551:0:7826:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787784458.385558:0:7826:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787784458.385566:0:7826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9ca4c 00010000:00080000:0.0:1787784458.385594:0:7826:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002a0c6c8c@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1787784458.390397:0:7826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1787784458.391566:0:7826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787784458.391581:0:7826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787784458.391616:0:7826:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787784458.391639:0:7826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9ca53 00000100:00080000:1.0:1787784458.391649:0:7826:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784458.391654:0:7826:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000002a0c6c8c using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784458.391699:0:7826:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f612e03a x1874627750015104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784458.391727:0:7826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1787784458.391799:0:7826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:01000000:1.0:1787784458.392041:0:7826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784458.392045:0:7826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784458.392046:0:7826:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787784458.392048:0:7826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784458.392055:0:7826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784458.392056:0:7826:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787784458.392058:0:7826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787784458.392059:0:7826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787784458.392084:0:7826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:7826:1874627750015232:0@lo:502: 00000100:00100000:1.0:1787784458.392158:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784458.392191:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750015232 00000100:00100000:1.0:1787784458.392195:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750015232 00000100:00100000:1.0:1787784458.392230:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787784458.392235:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd77f5c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:7826:x1874627750015232:12345-0@lo:502: 00000100:00100000:1.0:1787784458.392348:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd77f5c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:7826:x1874627750015232:12345-0@lo:502: Request processed in 112us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784458.392354:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787784458.392394:0:7826:0:(client.c:2715:ptlrpc_set_wait()) set 000000006a042a2a going to sleep for 11 seconds 00000100:00100000:1.0:1787784458.392414:0:7826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:7826:1874627750015232:0@lo:502: 00000020:01000000:1.0:1787784458.392441:0:7826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784458.392444:0:7826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784458.392445:0:7826:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787784458.392448:0:7826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787784458.392496:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787784458.392515:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787784458.392522:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 000000001695abed/0x88ace7295d9ca37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca3e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.392532:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 000000001695abed/0x88ace7295d9ca37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca3e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784458.392541:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787784458.392543:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8951cfef0000 from 1 10000000:01000000:1.0:1787784458.392545:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787784458.392568:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000005b887c5/0x88ace7295d9ca5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.392573:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000005b887c5/0x88ace7295d9ca5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784458.392579:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000005b887c5/0x88ace7295d9ca5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784458.392586:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750015360:0@lo:101: 00000100:00100000:1.0:1787784458.392604:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784458.392613:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 000000006a042a2a going to sleep for 11 seconds 00000100:00100000:0.0:1787784458.393159:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750015488:0@lo:400: 00000100:00100000:0.0:1787784458.393191:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784458.393209:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784458.393213:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b54138b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750015616:0@lo:400: 00000100:00100000:0.0:1787784458.393236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784458.393256:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784458.393261:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000220e7a63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750015744:0@lo:400: 00000100:00100000:0.0:1787784458.393281:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784458.393316:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750015616 00000100:00100000:0.0:1787784458.393321:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750015616 00000100:00100000:0.0:1787784458.393355:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784458.393361:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007db60c87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750015616:12345-0@lo:400: 00000100:00100000:0.0:1787784458.393402:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007db60c87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750015616:12345-0@lo:400: Request processed in 42us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784458.393409:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784458.393440:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b54138b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750015616:0@lo:400: 00000100:00100000:3.0:1787784458.393535:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750015104:0@lo:38: 00000100:00100000:3.0:1787784458.393576:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784458.393624:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750015488 00000100:00100000:3.0:1787784458.393627:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750015488 00000100:00100000:3.0:1787784458.393647:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750015744 00000100:00100000:3.0:1787784458.393648:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750015744 00000100:00100000:3.0:1787784458.393656:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784458.393660:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e03b750 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750015488:12345-0@lo:400: 00000100:00100000:3.0:1787784458.393697:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e03b750 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750015488:12345-0@lo:400: Request processed in 36us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784458.393701:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784458.393710:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784458.393713:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cda522cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750015744:12345-0@lo:400: 00000100:00100000:3.0:1787784458.393732:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cda522cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750015744:12345-0@lo:400: Request processed in 19us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784458.393736:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787784458.393755:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000220e7a63 x1874627750015744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784458.393763:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000220e7a63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750015744:0@lo:400: 00010000:00080000:3.0:1787784458.393801:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e77d7015 x1874627750015488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784458.393806:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e77d7015 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750015488:0@lo:400: 00000100:00100000:3.0:1787784458.393826:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750015360 00000100:00100000:3.0:1787784458.393829:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750015360 00000100:00100000:3.0:1787784458.393844:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787784458.393848:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e24b66d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750015360:12345-0@lo:101: 00010000:00010000:3.0:1787784458.394068:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784458.394085:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001ed302db/0x88ace7295d9ca61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ca5a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784458.394103:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001ed302db/0x88ace7295d9ca61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ca5a expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784458.394113:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001ed302db/0x88ace7295d9ca61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca5a expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784458.394121:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001ed302db, rc 0) 00000100:00100000:3.0:1787784458.394152:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e24b66d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750015360:12345-0@lo:101: Request processed in 304us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784458.394159:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787784458.394186:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750015360:0@lo:101: 00010000:00010000:3.0:1787784458.394197:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000005b887c5/0x88ace7295d9ca5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca61 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784458.394203:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000005b887c5/0x88ace7295d9ca5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ca61 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784458.394242:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d258b178 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750015872:0@lo:501: 00000100:00100000:3.0:1787784458.394259:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784458.394269:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021c37b25 going to sleep for 11 seconds 00000100:00100000:3.0:1787784458.394281:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750015872 00000100:00100000:3.0:1787784458.394284:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750015872 00000100:00100000:3.0:1787784458.394314:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787784458.394320:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd138b6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750015872:12345-0@lo:501: 00000100:00100000:3.0:1787784458.394381:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd138b6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750015872:12345-0@lo:501: Request processed in 62us (120us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784458.394392:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787784458.394415:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d258b178 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750015872:0@lo:501: 10000000:01000000:3.0:1787784458.394440:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787784458.394446:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000005b887c5/0x88ace7295d9ca5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca61 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784458.394453:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000005b887c5/0x88ace7295d9ca5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca61 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787784458.395228:0:7829:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000006ba4f1d x1874627750016000/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784458.395240:0:7829:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022c03a10 going to sleep for 0 seconds 00000100:00100000:0.0:1787784458.395318:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750015104 00000100:00100000:0.0:1787784458.395323:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750015104 00000100:00100000:0.0:1787784458.395357:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784458.395362:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdabdd67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750015104:12345-0@lo:38: 00010000:00080000:0.0:1787784458.395384:0:6527:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:0.0:1787784458.395413:0:6527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9ca68 00000004:00100000:0.0:1787784458.395433:0:6527:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787784458.395439:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787784458.409434:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000c038493d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784458.409707:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdabdd67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1874627750015104:12345-0@lo:38: Request processed in 14341us (16128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784458.409718:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787784458.411528:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787784458.411547:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787784458.411557:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787784458.411564:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787784458.411567:0:3643:0:(import.c:65:import_set_state_nolock()) 000000002a0c6c8c lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787784458.411592:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000022c03a10): req@0000000006ba4f1d x1874627750016000/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784458.411624:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f612e03a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750015104:0@lo:38: 00000100:00100000:2.0:1787784458.412022:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784458.412095:0:7829:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022c03a10 going to sleep for 11 seconds 00000100:00100000:0.0:1787784458.412212:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750016000 00000100:00100000:0.0:1787784458.412220:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750016000 00000100:00100000:0.0:1787784458.412287:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784458.412299:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e1ebd84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874627750016000:12345-0@lo:1000: 00000100:00100000:0.0:1787784458.412387:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e1ebd84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874627750016000:12345-0@lo:1000: Request processed in 89us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784458.412395:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784458.412468:0:7829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874627750016000:0@lo:1000: 00000040:01000000:2.0:1787784458.412514:0:7829:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787784458.412547:0:7829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d54a6a49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874627750016256:0@lo:1000: 00000100:00100000:2.0:1787784458.412577:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784458.412599:0:7829:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b7c327e going to sleep for 11 seconds 00000100:00100000:0.0:1787784458.412708:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750016256 00000100:00100000:0.0:1787784458.412712:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750016256 00000100:00100000:0.0:1787784458.412743:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784458.412750:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003509e83a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874627750016256:12345-0@lo:1000: 00000100:00100000:0.0:1787784458.412876:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003509e83a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874627750016256:12345-0@lo:1000: Request processed in 127us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784458.412883:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784458.412958:0:7829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d54a6a49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874627750016256:0@lo:1000: 00000100:00100000:2.0:1787784458.413000:0:7829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d54a6a49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874627750016384:0@lo:700: 00000100:00100000:2.0:1787784458.413026:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784458.413050:0:7829:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090a33d3a going to sleep for 11 seconds 00000100:00100000:3.0:1787784458.413120:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784458.413129:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8be2cac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750016128:0@lo:41: 00000100:00100000:3.0:1787784458.413156:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784458.413483:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750016384 00000100:00100000:0.0:1787784458.413488:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750016384 00000100:00100000:0.0:1787784458.413521:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784458.413527:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046bc9152 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7829:x1874627750016384:12345-0@lo:700: 00000100:00100000:0.0:1787784458.413570:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046bc9152 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7829:x1874627750016384:12345-0@lo:700: Request processed in 44us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784458.413577:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784458.413891:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750016128 00000100:00100000:2.0:1787784458.413895:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750016128 00000100:00100000:2.0:1787784458.413922:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787784458.413928:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d258b178 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750016128:12345-0@lo:41: 00000004:00000024:2.0:1787784458.413951:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787784458.413988:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d258b178 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750016128:12345-0@lo:41: Request processed in 60us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784458.413995:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787784458.414024:0:7829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d54a6a49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874627750016384:0@lo:700: 00000100:00100000:3.0:1787784458.414360:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8be2cac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750016128:0@lo:41: 00000100:00100000:2.0:1787784458.414650:0:7829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d54a6a49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874627750016512:0@lo:1000: 00000100:00100000:2.0:1787784458.414686:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784458.414751:0:7829:0:(client.c:2715:ptlrpc_set_wait()) set 000000007d8463ab going to sleep for 11 seconds 00000100:00100000:0.0:1787784458.414919:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750016512 00000100:00100000:0.0:1787784458.414932:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750016512 00000100:00100000:0.0:1787784458.414995:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787784458.415002:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086f9dd24 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874627750016512:12345-0@lo:1000: 00000100:00100000:0.0:1787784458.415123:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086f9dd24 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874627750016512:12345-0@lo:1000: Request processed in 122us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784458.415131:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787784458.415336:0:7829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d54a6a49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874627750016512:0@lo:1000: 00000004:00080000:3.0:1787784458.415381:0:7829:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000090a33d3a with version 0 00000020:00100000:3.0:1787784458.415396:0:7829:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787784458.415403:0:7829:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ef47fabb x1874627750016768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784458.415426:0:7829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874627750016768:0@lo:1000: 00000100:00100000:3.0:1787784458.415456:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784458.415606:0:7829:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021c37b25 going to sleep for 11 seconds 00000100:00100000:0.0:1787784458.415648:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750016768 00000100:00100000:0.0:1787784458.415653:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750016768 00000100:00100000:0.0:1787784458.415674:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787784458.415680:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6c23aa4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874627750016768:12345-0@lo:1000: 00000001:00080000:0.0:1787784458.425858:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1787784458.425874:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787784458.426132:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6c23aa4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7829:x1874627750016768:12345-0@lo:1000: Request processed in 10447us (10670us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787784458.426145:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1787784458.426294:0:7829:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1787784458.426299:0:7829:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787784458.426326:0:7829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874627750016768:0@lo:1000: 00000100:00100000:3.0:1787784458.426418:0:7829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874627750016896:0@lo:1000: 00000100:00100000:3.0:1787784458.426457:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784458.426585:0:7829:0:(client.c:2715:ptlrpc_set_wait()) set 000000003520c3d8 going to sleep for 11 seconds 00000100:00100000:2.0:1787784458.426715:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750016896 00000100:00100000:2.0:1787784458.426721:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750016896 00000100:00100000:2.0:1787784458.426797:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787784458.426806:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000620249be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7829:x1874627750016896:12345-0@lo:1000: 00000100:00100000:2.0:1787784458.427051:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000620249be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7829:x1874627750016896:12345-0@lo:1000: Request processed in 245us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784458.427060:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784458.430017:0:7829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef47fabb pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874627750016896:0@lo:1000: 00000040:00080000:3.0:1787784458.430059:0:7829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1787784458.430170:0:7829:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000021c37b25 with version 1 00000040:00080000:3.0:1787784458.432946:0:7829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787784458.433062:0:7827:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000bb4823fb version 1 rpc_version 1 00000004:00080000:3.0:1787784458.433261:0:7829:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787784458.433267:0:7829:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00100000:2.0:1787784458.433404:0:7827:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787784458.433415:0:7827:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004bffd905 x1874627750017152/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784458.433442:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004bffd905 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7827:1874627750017152:0@lo:1000: 00000100:00100000:2.0:1787784458.433584:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784458.433708:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000033edff10 going to sleep for 11 seconds 00000100:00100000:0.0:1787784458.434052:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750017152 00000100:00100000:0.0:1787784458.434060:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750017152 00000100:00100000:0.0:1787784458.434207:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787784458.434216:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e3758df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7827:x1874627750017152:12345-0@lo:1000: 00000001:00080000:0.0:1787784458.447830:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1787784458.448056:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e3758df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7827:x1874627750017152:12345-0@lo:1000: Request processed in 13838us (14469us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787784458.448070:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1787784458.448239:0:7827:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1787784458.448245:0:7827:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787784458.448262:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004bffd905 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7827:1874627750017152:0@lo:1000: 00010000:00010000:1.0:1787784458.759548:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787784459.471618:0:7879:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787784459.471863:0:7879:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787784459.781919:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784460.425004:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750017280:0@lo:41: 00000100:00100000:0.0:1787784460.425106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784460.425402:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750017280 00000100:00100000:1.0:1787784460.425411:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750017280 00000100:00100000:1.0:1787784460.425470:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787784460.425479:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000effb28cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750017280:12345-0@lo:41: 00000004:00000024:1.0:1787784460.425523:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1787784460.425573:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000effb28cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750017280:12345-0@lo:41: Request processed in 95us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784460.425581:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784460.425723:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750017280:0@lo:41: 00010000:00010000:1.0:1787784460.811958:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787784461.178551:0:7927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6d443eb0 20000000:00000080:2.0:1787784461.178580:0:7927:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8951fb302400 uarg=0000000000000000 20000000:01000000:2.0:1787784461.180122:0:7927:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787784461.180135:0:7927:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787784461.180142:0:7927:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787784461.180244:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787784461.180260:0:7927:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787784461.187431:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784461.187841:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787784461.187885:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787784461.187902:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787784461.188090:0:7927:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787784461.188115:0:7927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784461.188140:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fc863391/0x88ace7295d9c8ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c8e7 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784461.188149:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c9dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c9d5 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784461.188164:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784461.188217:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c9dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9c9d5 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784461.188233:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c9dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9c9d5 expref: 17 pid: 6513 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784461.188252:0:7927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095a222dd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874627750017408:0@lo:104: 00000100:00100000:3.0:1787784461.188353:0:7927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784461.188544:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787784461.188563:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750017408 00000100:00100000:2.0:1787784461.188572:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750017408 00010000:00010000:3.0:1787784461.188724:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fc863391/0x88ace7295d9c8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9c8e7 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784461.188733:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fc863391/0x88ace7295d9c8ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9c8e7 expref: 17 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784461.188743:0:7927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d18aaa68 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874627750017536:0@lo:104: 00000100:00100000:3.0:1787784461.188789:0:7927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784461.188991:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750017536 00000100:00100000:1.0:1787784461.189002:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750017536 00000100:00100000:2.0:1787784461.189386:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784461.189397:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000d431dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:7927:x1874627750017408:12345-0@lo:104: 00010000:00010000:2.0:1787784461.189413:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c9dc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784461.189485:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784461.189491:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000d431dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:7927:x1874627750017408:12345-0@lo:104: Request processed in 98us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784461.189500:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784461.190221:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784461.190232:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0889f6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:7927:x1874627750017536:12345-0@lo:104: 00010000:00010000:1.0:1787784461.190241:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c8ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.190315:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787784461.190319:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0889f6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:7927:x1874627750017536:12345-0@lo:104: Request processed in 92us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784461.190326:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787784461.190409:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784461.190416:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c9dc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784461.190424:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006a632fa5 already unused, calling callback (0000000051070f16) 10000000:00010000:0.0:1787784461.190428:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9c9dc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784461.190450:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9c9dc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784461.190459:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9c9dc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784461.190464:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784461.190511:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c9dc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784461.190720:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784461.190749:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c9dc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784461.190756:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 000000006a632fa5/0x88ace7295d9c9d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c9dc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784461.190790:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784461.190793:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c8ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784461.190798:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f0af91e4 already unused, calling callback (0000000051070f16) 10000000:00010000:0.0:1787784461.190801:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9c8ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784461.190806:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9c8ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784461.190811:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9c8ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784461.190821:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784461.190836:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c8ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784461.190841:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784461.190855:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c8ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784461.190860:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 00000000f0af91e4/0x88ace7295d9c8e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c8ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784461.190875:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784461.190877:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784461.190878:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784461.190886:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784461.190902:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f3c80ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750017664:0@lo:103: 00000100:00100000:0.0:1787784461.191120:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784461.191189:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750017664 00000100:00100000:1.0:1787784461.191196:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750017664 00010000:00010000:1.0:1787784461.191221:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c9dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c9d5 expref: 18 pid: 6513 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784461.191249:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784461.191257:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095deb419 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+18:3644:x1874627750017664:12345-0@lo:103: 00010000:00010000:1.0:1787784461.191270:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784461.191275:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c9dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c9d5 expref: 18 pid: 6513 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191295:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c9dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9c9d5 expref: 18 pid: 6513 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191316:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784461.191341:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095deb419 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+18:3644:x1874627750017664:12345-0@lo:103: Request processed in 85us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784461.191349:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784461.191439:0:7927:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8c79bf1 going to sleep for 11 seconds 00010000:00010000:3.0:1787784461.191467:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008c4b4de5/0x88ace7295d9c9dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9c9d5 expref: 17 pid: 6513 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784461.191479:0:7927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095a222dd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874627750017408:0@lo:104: 00000100:00100000:3.0:1787784461.191489:0:7927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d18aaa68 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874627750017536:0@lo:104: 00010000:00010000:3.0:1787784461.191516:0:7927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784461.191622:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007934b0bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750017792:0@lo:103: 00000100:00100000:1.0:1787784461.191659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784461.191702:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750017792 00000100:00100000:1.0:1787784461.191706:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750017792 00010000:00010000:1.0:1787784461.191719:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fc863391/0x88ace7295d9c8ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c8e7 expref: 17 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784461.191735:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784461.191740:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f612e03a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+17:3646:x1874627750017792:12345-0@lo:103: 00010000:00010000:1.0:1787784461.191747:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784461.191749:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fc863391/0x88ace7295d9c8ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c8e7 expref: 17 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191757:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fc863391/0x88ace7295d9c8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9c8e7 expref: 17 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191782:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fc863391/0x88ace7295d9c8ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9c8e7 expref: 17 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191794:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191802:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191819:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191826:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191831:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191843:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191848:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068d510bd already unused, calling callback (00000000b2725807) 00010000:00010000:1.0:1787784461.191851:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191858:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191867:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784461.191874:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784461.191900:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f612e03a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+16:3646:x1874627750017792:12345-0@lo:103: Request processed in 160us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784461.191906:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784461.191949:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007934b0bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750017792:0@lo:103: 00010000:00010000:3.0:1787784461.192221:0:7927:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784461.192235:0:7927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784461.192241:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068d510bd/0x88ace7295d9ca6f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784461.193805:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784461.196842:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f3c80ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750017664:0@lo:103: 00010000:00010000:0.0:1787784461.830908:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784462.857005:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784463.495344:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b989eaf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750017920:0@lo:400: 00000100:00100000:0.0:1787784463.495455:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784463.495528:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd2f0fdd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750018432:0@lo:400: 00000100:00100000:0.0:1787784463.495569:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784463.495600:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784463.495606:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b2c9b3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750018304:0@lo:400: 00000100:00100000:0.0:1787784463.495634:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784463.495666:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057bcf28b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750018048:0@lo:400: 00000100:00100000:0.0:1787784463.495709:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784463.495728:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784463.495732:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9dff405 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750018176:0@lo:400: 00000100:00100000:0.0:1787784463.495755:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784463.495831:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750018432 00000100:00100000:0.0:1787784463.495840:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750018432 00000100:00100000:0.0:1787784463.495884:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750018176 00000100:00100000:0.0:1787784463.495887:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750018176 00000100:00100000:0.0:1787784463.495905:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784463.496020:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ff54930 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750018432:12345-0@lo:400: 00000100:00100000:0.0:1787784463.496162:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ff54930 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750018432:12345-0@lo:400: Request processed in 145us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784463.496170:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784463.496192:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787784463.496197:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c45f1b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750018176:12345-0@lo:400: 00000100:00100000:0.0:1787784463.496225:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c45f1b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750018176:12345-0@lo:400: Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784463.496231:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787784463.496311:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9dff405 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750018176:0@lo:400: 00000100:00100000:0.0:1787784463.496337:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd2f0fdd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750018432:0@lo:400: 00000100:00100000:1.0:1787784463.499617:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750018304 00000100:00100000:1.0:1787784463.499640:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750018304 00000100:00100000:1.0:1787784463.499710:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750018048 00000100:00100000:1.0:1787784463.499713:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750018048 00000100:00100000:1.0:1787784463.499735:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784463.499744:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f98aba39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750018304:12345-0@lo:400: 00000100:00100000:0.0:1787784463.501212:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787784463.501230:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787784463.504214:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784463.504236:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000165d34ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750018048:12345-0@lo:400: 00000100:00100000:0.0:1787784463.504380:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000165d34ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750018048:12345-0@lo:400: Request processed in 151us (8670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784463.504388:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787784463.504481:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000057bcf28b x1874627750018048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784463.504498:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057bcf28b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750018048:0@lo:400: 00000100:00100000:1.0:1787784463.504763:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f98aba39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750018304:12345-0@lo:400: Request processed in 5019us (9127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784463.504790:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784463.505346:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750017920 00000100:00100000:1.0:1787784463.505355:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750017920 00000100:00100000:1.0:1787784463.505405:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787784463.505413:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfd350c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:3647:x1874627750017920:12345-0@lo:400: 00000100:00100000:1.0:1787784463.505456:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfd350c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:3647:x1874627750017920:12345-0@lo:400: Request processed in 45us (10003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784463.505463:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1787784463.505508:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001b2c9b3c x1874627750018304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784463.505520:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b2c9b3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750018304:0@lo:400: 00000100:00100000:1.0:1787784463.505530:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b989eaf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750017920:0@lo:400: 00000100:00100000:0.0:1787784463.509290:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057bcf28b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750018560:0@lo:41: 00000100:00100000:0.0:1787784463.509401:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784463.509476:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750018560 00000100:00100000:0.0:1787784463.509486:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750018560 00000100:00100000:0.0:1787784463.509541:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787784463.509550:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd2f0fdd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750018560:12345-0@lo:41: 00000004:00000024:0.0:1787784463.525517:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787784463.525690:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd2f0fdd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750018560:12345-0@lo:41: Request processed in 16136us (16285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784463.525704:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784463.526271:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057bcf28b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750018560:0@lo:41: 00010000:00010000:0.0:1787784463.879221:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784464.901978:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784465.542706:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784465.542736:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa16f154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750018688:0@lo:41: 00000100:00100000:1.0:1787784465.542854:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784465.543036:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750018688 00000100:00100000:2.0:1787784465.543053:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750018688 00000100:00100000:2.0:1787784465.549225:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787784465.549255:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f9696a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750018688:12345-0@lo:41: 00000004:00000024:2.0:1787784465.549312:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787784465.549434:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f9696a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750018688:12345-0@lo:41: Request processed in 196us (6580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784465.549443:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787784465.550736:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa16f154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750018688:0@lo:41: 00010000:00010000:0.0:1787784465.932659:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784466.952249:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787784467.598593:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787784467.598603:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951cfe95800 from 1 10000000:01000000:1.0:1787784467.598610:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787784467.598666:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000009319eeee/0x88ace7295d9ca76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784467.598681:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000009319eeee/0x88ace7295d9ca76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784467.598705:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000009319eeee/0x88ace7295d9ca76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784467.598735:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750018816:0@lo:101: 00000100:00100000:1.0:1787784467.598852:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784467.599021:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750018816 00000100:00100000:3.0:1787784467.599030:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750018816 00000100:00100000:3.0:1787784467.599088:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787784467.599099:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ad19828 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750018816:12345-0@lo:101: 00010000:00010000:3.0:1787784467.599116:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784467.599131:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045419dd9/0x88ace7295d9ca7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ca76 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784467.599161:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045419dd9/0x88ace7295d9ca7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ca76 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784467.599174:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045419dd9/0x88ace7295d9ca7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca76 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784467.599184:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045419dd9, rc 0) 00000100:00100000:3.0:1787784467.599235:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ad19828 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750018816:12345-0@lo:101: Request processed in 138us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784467.599243:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787784467.599419:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 000000009434ed3c going to sleep for 11 seconds 00000100:00100000:1.0:1787784467.599450:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750018816:0@lo:101: 00010000:00010000:1.0:1787784467.599466:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000009319eeee/0x88ace7295d9ca76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca7d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784467.599474:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000009319eeee/0x88ace7295d9ca76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ca7d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784467.599542:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750018944:0@lo:501: 00000100:00100000:1.0:1787784467.599570:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784467.599591:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 000000009434ed3c going to sleep for 11 seconds 00000100:00100000:0.0:1787784467.599729:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750018944 00000100:00100000:0.0:1787784467.599735:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750018944 00000100:00100000:0.0:1787784467.599792:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787784467.599799:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb3fb4dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750018944:12345-0@lo:501: 00000100:00100000:0.0:1787784467.601114:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb3fb4dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750018944:12345-0@lo:501: Request processed in 1307us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784467.601129:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787784467.601193:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006ba4f1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750018944:0@lo:501: 00000100:00100000:0.0:1787784467.601253:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9dff405 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750019072:0@lo:503: 00000100:00100000:0.0:1787784467.601304:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784467.601326:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee4d0df9 going to sleep for 11 seconds 00000100:00100000:0.0:1787784467.601355:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750019072 00000100:00100000:0.0:1787784467.601361:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750019072 00000100:00100000:0.0:1787784467.601396:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787784467.601404:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000954ae163 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750019072:12345-0@lo:503: 00000100:00100000:0.0:1787784467.601517:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000954ae163 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750019072:12345-0@lo:503: Request processed in 113us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784467.601524:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787784467.601566:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9dff405 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750019072:0@lo:503: 00000100:00100000:0.0:1787784467.601799:0:8148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9dff405 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8148:1874627750019200:0@lo:502: 00000100:00100000:0.0:1787784467.601832:0:8148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784467.601849:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750019200 00000100:00100000:0.0:1787784467.601853:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750019200 00000100:00100000:0.0:1787784467.601872:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787784467.601877:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5bdf7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:8148:x1874627750019200:12345-0@lo:502: 00000100:00100000:3.0:1787784467.603557:0:8148:0:(client.c:2715:ptlrpc_set_wait()) set 0000000080f4df7f going to sleep for 11 seconds 00000100:00100000:0.0:1787784467.603747:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5bdf7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:8148:x1874627750019200:12345-0@lo:502: Request processed in 1867us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784467.603757:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787784467.606884:0:8148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9dff405 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8148:1874627750019200:0@lo:502: 00000020:01000000:3.0:1787784467.607296:0:8148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784467.607312:0:8148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784467.607325:0:8148:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787784467.607338:0:8148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951cfe95800 00000020:00000080:3.0:1787784467.607342:0:8148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787784467.607424:0:8148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8148:1874627750019328:0@lo:502: 00000100:00100000:3.0:1787784467.607508:0:8148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784467.607559:0:8148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df646240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784467.612972:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750019328 00000100:00100000:2.0:1787784467.612994:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750019328 00000100:00100000:2.0:1787784467.613079:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787784467.613092:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:8148:x1874627750019328:12345-0@lo:502: 00000100:00100000:2.0:1787784467.613487:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:8148:x1874627750019328:12345-0@lo:502: Request processed in 396us (5979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784467.613496:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787784467.615530:0:8148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8148:1874627750019328:0@lo:502: 00000020:01000000:3.0:1787784467.615590:0:8148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784467.615603:0:8148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784467.615606:0:8148:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787784467.615613:0:8148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787784467.616072:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787784467.616107:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787784467.616121:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9ca76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca7d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784467.616135:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9ca76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca7d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784467.616148:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787784467.616150:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951d08ed800 from 1 10000000:01000000:0.0:1787784467.616154:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784467.616204:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784467.616214:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784467.616270:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784467.616295:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5290780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750019456:0@lo:101: 00000100:00100000:0.0:1787784467.616372:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784467.616426:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e326c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784467.616481:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750019456 00000100:00100000:2.0:1787784467.616490:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750019456 00000100:00100000:2.0:1787784467.616553:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787784467.616564:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750019456:12345-0@lo:101: 00010000:00010000:2.0:1787784467.616580:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784467.616598:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c13ff400/0x88ace7295d9ca8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ca84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784467.616636:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c13ff400/0x88ace7295d9ca8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ca84 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784467.616648:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c13ff400/0x88ace7295d9ca8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca84 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784467.616658:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c13ff400, rc 0) 00000100:00100000:2.0:1787784467.616712:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750019456:12345-0@lo:101: Request processed in 149us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784467.616719:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787784467.617191:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5290780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750019456:0@lo:101: 00010000:00010000:3.0:1787784467.617208:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca8b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784467.617229:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ca8b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784467.617300:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750019584:0@lo:501: 00000100:00100000:3.0:1787784467.617333:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784467.617362:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df646240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784467.617405:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750019584 00000100:00100000:2.0:1787784467.617409:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750019584 00000100:00100000:2.0:1787784467.617443:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787784467.617450:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750019584:12345-0@lo:501: 00000100:00100000:2.0:1787784467.617576:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750019584:12345-0@lo:501: Request processed in 126us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784467.617583:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787784467.617633:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750019584:0@lo:501: 00000100:00100000:3.0:1787784467.617659:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750019712:0@lo:503: 00000100:00100000:3.0:1787784467.617695:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784467.617717:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df646240 going to sleep for 11 seconds 00000100:00100000:0.0:1787784467.617757:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750019712 00000100:00100000:0.0:1787784467.617762:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750019712 00000100:00100000:1.0:1787784467.617823:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787784467.617833:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750019712:12345-0@lo:503: 00000100:00100000:1.0:1787784467.617927:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750019712:12345-0@lo:503: Request processed in 96us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784467.617934:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787784467.617935:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750019712:0@lo:503: 00000100:00100000:2.0:1787784467.620212:0:8150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e130c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8150:1874627750019840:0@lo:502: 00000100:00100000:2.0:1787784467.620307:0:8150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784467.620359:0:8150:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24daa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784467.620449:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750019840 00000100:00100000:1.0:1787784467.620457:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750019840 00000100:00100000:1.0:1787784467.620511:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787784467.620522:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:8150:x1874627750019840:12345-0@lo:502: 00000100:00100000:1.0:1787784467.620656:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:8150:x1874627750019840:12345-0@lo:502: Request processed in 135us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784467.620671:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787784467.620809:0:8150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e130c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8150:1874627750019840:0@lo:502: 00000020:01000000:3.0:1787784467.620847:0:8150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784467.620858:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784467.620861:0:8150:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787784467.620869:0:8150:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951d08ed800 00000020:00000080:3.0:1787784467.620884:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787784467.621063:0:8150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8150:1874627750019968:0@lo:502: 00000100:00100000:3.0:1787784467.621101:0:8150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784467.621130:0:8150:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df646240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784467.621172:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750019968 00000100:00100000:2.0:1787784467.621176:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750019968 00000100:00100000:2.0:1787784467.621203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787784467.621209:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+18:8150:x1874627750019968:12345-0@lo:502: 00000100:00100000:2.0:1787784467.621298:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+18:8150:x1874627750019968:12345-0@lo:502: Request processed in 89us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784467.621314:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787784467.621377:0:8150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8150:1874627750019968:0@lo:502: 00000020:01000000:3.0:1787784467.621393:0:8150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784467.621397:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784467.621399:0:8150:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787784467.621402:0:8150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787784467.621559:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787784467.621587:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784467.621600:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca8b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784467.621612:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ca8b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784467.977947:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784468.614459:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750020096:0@lo:400: 00000100:00100000:0.0:1787784468.614534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784468.614589:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750020608:0@lo:400: 00000100:00100000:0.0:1787784468.614617:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784468.614642:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784468.614648:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750020224:0@lo:400: 00000100:00100000:0.0:1787784468.614671:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784468.614696:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750020480:0@lo:400: 00000100:00100000:0.0:1787784468.614718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784468.614751:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784468.614758:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750020352:0@lo:400: 00000100:00100000:0.0:1787784468.614807:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784468.614834:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750020224 00000100:00100000:0.0:1787784468.614840:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750020224 00000100:00100000:0.0:1787784468.614895:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750020480 00000100:00100000:0.0:1787784468.614898:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750020480 00000100:00100000:0.0:1787784468.614918:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784468.614926:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750020224:12345-0@lo:400: 00000100:00100000:2.0:1787784468.615974:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750020096 00000100:00100000:2.0:1787784468.615989:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750020096 00000100:00100000:2.0:1787784468.616033:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787784468.616042:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+18:3646:x1874627750020096:12345-0@lo:400: 00000100:00100000:0.0:1787784468.616119:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750020224:12345-0@lo:400: Request processed in 1192us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784468.616128:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784468.616148:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784468.616155:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750020480:12345-0@lo:400: 00000100:00100000:0.0:1787784468.616193:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750020480:12345-0@lo:400: Request processed in 40us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784468.616199:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784468.616228:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750020608 00000100:00100000:0.0:1787784468.616233:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750020608 00000100:00100000:0.0:1787784468.616250:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750020352 00000100:00100000:0.0:1787784468.616253:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750020352 00000100:00100000:0.0:1787784468.616264:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787784468.616269:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750020608:12345-0@lo:400: 00000100:00100000:2.0:1787784468.619670:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+18:3646:x1874627750020096:12345-0@lo:400: Request processed in 3618us (5126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784468.619686:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787784468.620127:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750020608:12345-0@lo:400: Request processed in 3853us (5505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784468.620135:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787784468.620159:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787784468.620170:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750020352:12345-0@lo:400: 00000100:00100000:0.0:1787784468.620250:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750020352:12345-0@lo:400: Request processed in 85us (5442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784468.620257:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787784468.620308:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750020352:0@lo:400: 00010000:00080000:0.0:1787784468.620356:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951f52912c0 x1874627750020480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784468.620369:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750020480:0@lo:400: 00010000:00080000:3.0:1787784468.620544:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951f5292d00 x1874627750020224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784468.620556:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750020224:0@lo:400: 00000100:00100000:3.0:1787784468.620567:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750020096:0@lo:400: 00000100:00100000:3.0:1787784468.620577:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750020608:0@lo:400: 00000100:00100000:3.0:1787784468.620593:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784468.620604:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750020736:0@lo:41: 00000100:00100000:3.0:1787784468.620639:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784468.621757:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750020736 00000100:00100000:0.0:1787784468.621786:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750020736 00000100:00100000:0.0:1787784468.621828:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784468.621836:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750020736:12345-0@lo:41: 00000004:00000024:0.0:1787784468.621865:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787784468.621925:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750020736:12345-0@lo:41: Request processed in 90us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784468.621931:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784468.629220:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750020736:0@lo:41: 00010000:00010000:2.0:1787784468.998047:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784470.022120:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784470.663253:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784470.666967:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750020864:0@lo:41: 00000100:00100000:1.0:1787784470.667042:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784470.667821:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750020864 00000100:00100000:0.0:1787784470.667831:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750020864 00000100:00100000:0.0:1787784470.667892:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784470.667901:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750020864:12345-0@lo:41: 00000004:00000024:0.0:1787784470.667936:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1787784470.667996:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750020864:12345-0@lo:41: Request processed in 96us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784470.668002:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784470.668051:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750020864:0@lo:41: 00010000:00010000:2.0:1787784471.047350:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784472.074096:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784473.097299:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784473.735886:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750020992:0@lo:41: 00000100:00100000:0.0:1787784473.735954:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784473.736026:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750020992 00000100:00100000:0.0:1787784473.736044:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750020992 00000100:00100000:0.0:1787784473.736088:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787784473.736097:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750020992:12345-0@lo:41: 00000004:00000024:0.0:1787784473.736129:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787784473.736183:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750020992:12345-0@lo:41: Request processed in 87us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784473.736190:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787784473.736233:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750020992:0@lo:41: 00000100:00100000:1.0:1787784473.737068:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750021120:0@lo:400: 00000100:00100000:1.0:1787784473.737112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784473.737143:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784473.737150:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750021248:0@lo:400: 00000100:00100000:1.0:1787784473.737199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784473.737230:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750021120 00000100:00100000:1.0:1787784473.737236:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750021120 00000100:00100000:1.0:1787784473.737278:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787784473.737285:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:3646:x1874627750021120:12345-0@lo:400: 00000100:00100000:1.0:1787784473.737323:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:3646:x1874627750021120:12345-0@lo:400: Request processed in 38us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784473.737330:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787784473.737367:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750021120:0@lo:400: 00000100:00100000:0.0:1787784473.737941:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750021248 00000100:00100000:0.0:1787784473.737947:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750021248 00000100:00100000:0.0:1787784473.737984:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784473.737992:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750021248:12345-0@lo:400: 00000100:00100000:0.0:1787784473.738040:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750021248:12345-0@lo:400: Request processed in 49us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784473.738048:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784473.738066:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750021376:0@lo:400: 00000100:00100000:0.0:1787784473.738093:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784473.738115:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784473.738120:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1196580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750021504:0@lo:400: 00000100:00100000:0.0:1787784473.738143:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784473.738181:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750021504 00000100:00100000:0.0:1787784473.738186:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750021504 00000100:00100000:0.0:1787784473.738209:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784473.738215:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750021504:12345-0@lo:400: 00000100:00100000:0.0:1787784473.738249:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750021504:12345-0@lo:400: Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784473.738255:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787784473.738297:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951e1196580 x1874627750021504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784473.738309:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1196580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750021504:0@lo:400: 00000100:00100000:0.0:1787784473.738329:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750021376 00000100:00100000:0.0:1787784473.738332:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750021376 00000100:00100000:0.0:1787784473.738353:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787784473.738359:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750021376:12345-0@lo:400: 00000100:00100000:0.0:1787784473.738393:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750021376:12345-0@lo:400: Request processed in 34us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784473.738399:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787784473.738424:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750021376:0@lo:400: 00010000:00080000:0.0:1787784473.738445:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951e1ffe1c0 x1874627750021248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784473.738454:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750021248:0@lo:400: 00010000:00010000:0.0:1787784474.127646:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787784474.258637:0:8429:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787784474.258642:0:8429:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787784474.258644:0:8429:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787784474.258829:0:8429:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8951efedf000 00000020:01000004:2.0:1787784474.258846:0:8429:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787784474.258859:0:8429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787784474.258873:0:8429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8951cfef3370) 00000020:00000080:2.0:1787784474.258890:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787784474.327915:0:8429:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787784474.327975:0:8429:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1787784474.375013:0:8429:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787784474.375327:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787784474.375338:0:8429:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787784474.375350:0:8429:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x88ace7295d9ca99 00000020:01000004:0.0:1787784474.375358:0:8429:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787784474.375380:0:8429:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787784474.375383:0:8429:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787784474.375390:0:8429:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787784474.375395:0:8429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787784474.375405:0:8429:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8951fb388000) 00000020:00000080:0.0:1787784474.375416:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1787784474.380701:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784474.383214:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787784474.383223:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787784474.385507:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787784474.385520:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787784474.392214:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787784474.392229:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787784474.408225:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784474.409045:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787784474.409054:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787784474.413854:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787784474.413872:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787784474.480756:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784474.481058:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787784474.481064:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787784474.486323:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787784474.486347:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787784474.493051:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787784474.493067:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787784474.503114:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784474.509268:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787784474.509277:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787784474.510722:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787784474.510734:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787784474.640537:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784474.641008:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787784474.641015:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787784474.642312:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787784474.642323:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787784474.642730:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787784474.642758:0:8429:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787784474.642764:0:8429:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787784474.666219:0:8429:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787784474.666260:0:8429:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787784474.666264:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787784474.666266:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787784474.666267:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784474.666269:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784474.666270:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784474.666271:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784474.666273:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784474.666275:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787784474.666276:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787784474.666278:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784474.666280:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784474.666284:0:8429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787784474.666287:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787784474.666288:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787784474.666289:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784474.666290:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784474.666291:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784474.666292:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784474.666293:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784474.666294:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787784474.666295:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787784474.666296:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784474.666297:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784474.666339:0:8429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787784474.666358:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750021632:0@lo:253: 00000100:00100000:0.0:1787784474.666432:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.666506:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f47900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784474.668705:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750021632 00000100:00100000:2.0:1787784474.668720:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750021632 00000100:00100000:2.0:1787784474.668829:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787784474.668840:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+18:8429:x1874627750021632:12345-0@lo:253: 20000000:01000000:2.0:1787784474.668878:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787784474.668883:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787784474.668888:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787784474.668891:0:6516:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787784474.669211:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784474.669399:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787784474.669414:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787784474.669433:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787784474.669441:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787784474.669452:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787784474.669465:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787784474.669550:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787784474.669565:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:2.0:1787784474.669567:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:2.0:1787784474.669582:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787784474.669588:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787784474.669601:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787784474.669606:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:2.0:1787784474.669617:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787784474.669623:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787784474.669636:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787784474.669652:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787784474.669741:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1787784474.669752:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:2.0:1787784474.669754:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:2.0:1787784474.669797:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1787784474.669804:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787784474.669821:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1787784474.669826:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:2.0:1787784474.669853:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1787784474.669861:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787784474.669874:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1787784474.669889:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1787784474.670286:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1787784474.670297:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:2.0:1787784474.670299:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:2.0:1787784474.670314:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1787784474.670320:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787784474.670333:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1787784474.670339:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:2.0:1787784474.670352:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1787784474.670357:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787784474.670368:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1787784474.670382:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1787784474.670394:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787784474.670397:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787784474.670400:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787784474.670444:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787784474.670447:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787784474.671828:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1787784474.671874:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1787784474.671894:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1787784474.672369:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1787784474.672392:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1787784474.672408:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1787784474.672417:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787784474.672419:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787784474.673175:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1787784474.673205:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1787784474.673222:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787784474.673424:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787784474.673444:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787784474.673459:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787784474.673467:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787784474.673469:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787784474.674292:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787784474.674473:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787784474.674512:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787784474.674530:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787784474.674539:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787784474.674541:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787784474.675345:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1787784474.675371:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1787784474.675386:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787784474.675559:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1787784474.675579:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1787784474.675593:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:2.0:1787784474.675611:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787784474.675633:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.675652:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c13ff000/0x88ace7295d9c973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c96c expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.675660:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d34400/0x88ace7295d9c9ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9c9e3 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.675666:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c0031800/0x88ace7295d9ca22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca1b expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.675672:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9ca3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca37 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.675679:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c151e400/0x88ace7295d9ca61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca5a expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.675687:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.675740:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c151e400/0x88ace7295d9ca61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ca5a expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.675756:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951c151e400/0x88ace7295d9ca61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ca5a expref: 18 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784474.676125:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e11e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750021760:0@lo:104: 00000100:00100000:2.0:1787784474.676207:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787784474.676269:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9ca3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ca37 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.676279:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9ca3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ca37 expref: 18 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784474.676287:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e13480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750021888:0@lo:104: 00000100:00100000:2.0:1787784474.676309:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787784474.676344:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c0031800/0x88ace7295d9ca22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ca1b expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.676352:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951c0031800/0x88ace7295d9ca22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ca1b expref: 18 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784474.676359:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e130c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750022016:0@lo:104: 00000100:00100000:2.0:1787784474.676393:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787784474.676416:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d34400/0x88ace7295d9c9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9c9e3 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.676425:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951e1d34400/0x88ace7295d9c9ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9c9e3 expref: 18 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784474.676445:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750022144:0@lo:104: 00000100:00100000:2.0:1787784474.676469:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787784474.676485:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c13ff000/0x88ace7295d9c973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9c96c expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.676494:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951c13ff000/0x88ace7295d9c973 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9c96c expref: 18 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784474.676501:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f6580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750022272:0@lo:104: 00000100:00100000:2.0:1787784474.676520:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784474.676529:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d2148480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784474.676601:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750021760 00000100:00100000:3.0:1787784474.676609:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750021760 00000100:00100000:3.0:1787784474.676645:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750021888 00000100:00100000:3.0:1787784474.676649:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750021888 00000100:00100000:3.0:1787784474.676660:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750022016 00000100:00100000:3.0:1787784474.676662:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750022016 00000100:00100000:3.0:1787784474.676669:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750022144 00000100:00100000:3.0:1787784474.676671:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750022144 00000100:00100000:3.0:1787784474.676677:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750022272 00000100:00100000:3.0:1787784474.676679:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750022272 00000100:00100000:3.0:1787784474.676692:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784474.676700:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e10f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+7:6516:x1874627750021760:12345-0@lo:104: 00010000:00010000:3.0:1787784474.676714:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951e1d35200/0x88ace7295d9ca5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca61 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.676798:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784474.676804:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e10f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+7:6516:x1874627750021760:12345-0@lo:104: Request processed in 105us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.676822:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784474.676839:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787784474.676845:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e112c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+6:6516:x1874627750021888:12345-0@lo:104: 00010000:00010000:3.0:1787784474.676853:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9ca37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca3e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.676886:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787784474.676891:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e112c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+6:6516:x1874627750021888:12345-0@lo:104: Request processed in 47us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.676907:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787784474.676919:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787784474.676925:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+5:6516:x1874627750022016:12345-0@lo:104: 00010000:00010000:3.0:1787784474.676933:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951e1d35600/0x88ace7295d9ca1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca22 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.676961:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787784474.676966:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+5:6516:x1874627750022016:12345-0@lo:104: Request processed in 42us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.676971:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787784474.676983:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787784474.676989:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:6516:x1874627750022144:12345-0@lo:104: 00010000:00010000:3.0:1787784474.676995:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9c9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c9ea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677021:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787784474.677026:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:6516:x1874627750022144:12345-0@lo:104: Request processed in 38us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.677168:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787784474.677181:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787784474.677187:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:6516:x1874627750022272:12345-0@lo:104: 00010000:00010000:3.0:1787784474.677194:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9c96c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c973 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677219:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787784474.677224:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:6516:x1874627750022272:12345-0@lo:104: Request processed in 38us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.677235:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787784474.677252:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787784474.677258:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951e1d35200/0x88ace7295d9ca5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca61 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677264:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35200 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784474.677268:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35200/0x88ace7295d9ca5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ca61 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677276:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951e1d35200/0x88ace7295d9ca5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ca61 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784474.677282:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35200/0x88ace7295d9ca5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ca61 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784474.677288:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787784474.677320:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951e1d35200/0x88ace7295d9ca5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca61 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677326:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784474.677344:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951e1d35200/0x88ace7295d9ca5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca61 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677351:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951e1d35200/0x88ace7295d9ca5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca61 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677367:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787784474.677371:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9ca37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca3e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677387:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784474.677390:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9ca37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ca3e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677397:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9ca37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ca3e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784474.677403:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9ca37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ca3e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784474.677408:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787784474.677422:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9ca37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca3e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677428:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784474.677433:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9ca37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca3e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677440:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9ca37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca3e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677451:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787784474.677454:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951e1d35600/0x88ace7295d9ca1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca22 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677460:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35600 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784474.677462:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35600/0x88ace7295d9ca1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ca22 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677479:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951e1d35600/0x88ace7295d9ca1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ca22 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784474.677485:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35600/0x88ace7295d9ca1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ca22 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784474.677490:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787784474.677502:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951e1d35600/0x88ace7295d9ca1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca22 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677508:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784474.677521:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951e1d35600/0x88ace7295d9ca1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca22 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677527:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951e1d35600/0x88ace7295d9ca1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca22 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677536:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784474.677539:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9c9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c9ea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677544:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151fc00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784474.677546:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9c9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9c9ea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677552:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9c9e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9c9ea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784474.677558:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9c9e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9c9ea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784474.677569:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787784474.677583:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9c9e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c9ea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677589:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784474.677594:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9c9e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c9ea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677600:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9c9e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c9ea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677609:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784474.677612:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9c96c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9c973 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677618:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784474.677621:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9c96c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9c973 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677627:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9c96c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9c973 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784474.677633:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9c96c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9c973 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784474.677639:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787784474.677650:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9c96c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c973 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677655:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784474.677666:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9c96c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c973 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677672:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9c96c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9c973 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.677687:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784474.677689:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784474.677690:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784474.677714:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750022400:0@lo:103: 00000100:00100000:3.0:1787784474.677752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784474.677806:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750022912:0@lo:103: 00000100:00100000:3.0:1787784474.677914:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784474.677936:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784474.677942:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750022528:0@lo:103: 00000100:00100000:3.0:1787784474.677962:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784474.677989:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5316580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750022656:0@lo:103: 00000100:00100000:3.0:1787784474.678010:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784474.678022:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784474.678028:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750022784:0@lo:103: 00000100:00100000:2.0:1787784474.678179:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e11e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750021760:0@lo:104: 00000100:00100000:2.0:1787784474.678192:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e13480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750021888:0@lo:104: 00000100:00100000:2.0:1787784474.678200:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e130c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750022016:0@lo:104: 00000100:00100000:2.0:1787784474.678208:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750022144:0@lo:104: 00000100:00100000:2.0:1787784474.678215:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f6580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750022272:0@lo:104: 00010000:00010000:2.0:1787784474.678246:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784474.678435:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784474.678473:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750022400 00000100:00100000:3.0:1787784474.678479:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750022400 00010000:00010000:3.0:1787784474.678506:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c151e400/0x88ace7295d9ca61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca5a expref: 19 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784474.678524:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750022912 00000100:00100000:3.0:1787784474.678526:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750022912 00010000:00010000:3.0:1787784474.678537:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c13ff000/0x88ace7295d9c973 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c96c expref: 20 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784474.678558:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750022528 00000100:00100000:3.0:1787784474.678561:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750022528 00010000:00010000:3.0:1787784474.678572:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9ca3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca37 expref: 21 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784474.678581:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750022656 00000100:00100000:3.0:1787784474.678583:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750022656 00010000:00010000:3.0:1787784474.678594:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c0031800/0x88ace7295d9ca22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca1b expref: 22 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784474.678602:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750022784 00000100:00100000:3.0:1787784474.678604:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750022784 00010000:00010000:3.0:1787784474.678612:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d34400/0x88ace7295d9c9ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c9e3 expref: 23 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784474.678623:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784474.678631:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+23:3646:x1874627750022400:12345-0@lo:103: 00010000:00010000:3.0:1787784474.678654:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784474.678660:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c151e400/0x88ace7295d9ca61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca5a expref: 23 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.678670:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c151e400/0x88ace7295d9ca61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ca5a expref: 23 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.678685:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c151e400/0x88ace7295d9ca61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ca5a expref: 23 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.678701:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784474.678743:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+22:3646:x1874627750022400:12345-0@lo:103: Request processed in 113us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.678757:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784474.678796:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787784474.678803:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5317840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+21:3646:x1874627750022912:12345-0@lo:103: 00010000:00010000:3.0:1787784474.678976:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784474.678982:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c13ff000/0x88ace7295d9c973 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c96c expref: 21 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.678992:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c13ff000/0x88ace7295d9c973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9c96c expref: 21 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.679002:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c13ff000/0x88ace7295d9c973 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9c96c expref: 21 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.679012:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784474.680988:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787784474.681008:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1787784474.681044:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784474.681332:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5317840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+20:3646:x1874627750022912:12345-0@lo:103: Request processed in 2525us (3413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.681344:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787784474.681377:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787784474.681389:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5315680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+19:3646:x1874627750022528:12345-0@lo:103: 00010000:00010000:3.0:1787784474.681408:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784474.681417:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9ca3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca37 expref: 19 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681434:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9ca3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ca37 expref: 19 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681451:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9ca3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ca37 expref: 19 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681478:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784474.681520:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5315680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+18:3646:x1874627750022528:12345-0@lo:103: Request processed in 136us (3557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.681526:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787784474.681538:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787784474.681544:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5316940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+17:3644:x1874627750022656:12345-0@lo:103: 00010000:00010000:3.0:1787784474.681552:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784474.681556:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c0031800/0x88ace7295d9ca22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca1b expref: 17 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681564:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c0031800/0x88ace7295d9ca22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ca1b expref: 17 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681573:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c0031800/0x88ace7295d9ca22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ca1b expref: 17 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681582:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784474.681620:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5316940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+16:3644:x1874627750022656:12345-0@lo:103: Request processed in 76us (3609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.681627:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787784474.681639:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787784474.681646:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfebc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+15:3644:x1874627750022784:12345-0@lo:103: 00010000:00010000:3.0:1787784474.681653:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784474.681658:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d34400/0x88ace7295d9c9ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9c9e3 expref: 15 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681666:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d34400/0x88ace7295d9c9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9c9e3 expref: 15 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681681:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34400/0x88ace7295d9c9ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9c9e3 expref: 15 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681692:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681701:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681714:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681721:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681728:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681735:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681742:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c13fee00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784474.681746:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681753:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681786:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.681808:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784474.683084:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5316580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750022656:0@lo:103: 00000100:00100000:2.0:1787784474.683269:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750022528:0@lo:103: 00000100:00100000:2.0:1787784474.683281:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750022400:0@lo:103: 00000100:00100000:2.0:1787784474.683291:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750022912:0@lo:103: 00010000:00010000:2.0:1787784474.683325:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.683346:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.683352:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c13fee00/0x88ace7295d9caa7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787784474.683370:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787784474.683564:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfebc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+14:3644:x1874627750022784:12345-0@lo:103: Request processed in 1917us (5126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.683575:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784474.688171:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+13:8429:x1874627750021632:12345-0@lo:253: Request processed in 19309us (21714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784474.688186:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787784474.688340:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750021632:0@lo:253: 10000000:01000000:1.0:1787784474.688356:0:8429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787784474.688359:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787784474.688361:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787784474.688362:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784474.688364:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787784474.688365:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784474.688367:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784474.688368:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784474.688369:0:8429:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787784474.688371:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784474.688372:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787784474.688393:0:8429:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8951efedf000 from lustre-OST0000 10000000:01000000:1.0:1787784474.688425:0:8429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787784474.688428:0:8429:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787784474.688437:0:8429:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8951cfef0000 local copy 10000000:01000000:1.0:1787784474.688441:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787784474.688480:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.688491:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.688526:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784474.688545:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023040:0@lo:101: 00000100:00100000:1.0:1787784474.688583:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784474.688620:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f47900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784474.688919:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750023040 00000100:00100000:3.0:1787784474.688925:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750023040 00000100:00100000:3.0:1787784474.688973:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787784474.688983:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+13:8429:x1874627750023040:12345-0@lo:101: 00010000:00010000:3.0:1787784474.688996:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784474.689009:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c151f600/0x88ace7295d9cab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9caae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.689044:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c151f600/0x88ace7295d9cab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9caae expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.689055:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c151f600/0x88ace7295d9cab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9caae expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.689064:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151f600, rc 0) 00000100:00100000:3.0:1787784474.689104:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+14:8429:x1874627750023040:12345-0@lo:101: Request processed in 123us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.689111:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787784474.689944:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023040:0@lo:101: 00010000:00010000:0.0:1787784474.689962:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x88ace7295d9cab5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.689972:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x88ace7295d9cab5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784474.690087:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023168:0@lo:501: 00000100:00100000:0.0:1787784474.690125:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.690173:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d212ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784474.690287:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750023168 00000100:00100000:1.0:1787784474.690293:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750023168 00000100:00100000:1.0:1787784474.690328:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787784474.690338:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+14:8429:x1874627750023168:12345-0@lo:501: 00000100:00100000:1.0:1787784474.690408:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+14:8429:x1874627750023168:12345-0@lo:501: Request processed in 71us (282us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787784474.690416:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787784474.690482:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023168:0@lo:501: 10000000:01000000:0.0:1787784474.690494:0:8429:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787784474.690511:0:8429:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787784474.690516:0:8429:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x88ace7295d9cab5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.690524:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x88ace7295d9cab5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.690531:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x88ace7295d9cab5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.690590:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787784474.690614:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8951efedf000 10000000:01000000:0.0:1787784474.690630:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787784474.690636:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787784474.690639:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787784474.690643:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787784474.690645:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787784474.690663:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.690671:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.690678:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784474.690691:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023296:0@lo:101: 00000100:00100000:0.0:1787784474.690716:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.690730:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d212b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784474.690801:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750023296 00000100:00100000:3.0:1787784474.690806:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750023296 00000100:00100000:3.0:1787784474.690845:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787784474.690852:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+14:8429:x1874627750023296:12345-0@lo:101: 00010000:00010000:3.0:1787784474.690860:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784474.690876:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c151f200/0x88ace7295d9cac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cabc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.690893:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c151f200/0x88ace7295d9cac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cabc expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.690902:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c151f200/0x88ace7295d9cac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cabc expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.690911:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151f200, rc 0) 00000100:00100000:3.0:1787784474.690941:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750023296:12345-0@lo:101: Request processed in 90us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.690947:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787784474.691168:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023296:0@lo:101: 00010000:00010000:0.0:1787784474.691180:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cac3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.691189:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cac3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784474.691259:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023424:0@lo:501: 00000100:00100000:0.0:1787784474.691288:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.691318:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d212b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784474.691435:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750023424 00000100:00100000:3.0:1787784474.691439:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750023424 00000100:00100000:3.0:1787784474.691472:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787784474.691480:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750023424:12345-0@lo:501: 00000100:00100000:3.0:1787784474.691579:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750023424:12345-0@lo:501: Request processed in 99us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.691586:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787784474.691654:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023424:0@lo:501: 00000100:00100000:0.0:1787784474.692381:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023552:0@lo:503: 00000100:00100000:0.0:1787784474.692429:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.692458:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d212b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784474.692642:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750022784:0@lo:103: 00000100:00100000:3.0:1787784474.692674:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750023552 00000100:00100000:3.0:1787784474.692679:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750023552 00000100:00100000:3.0:1787784474.692716:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787784474.692725:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750023552:12345-0@lo:503: 00000100:00100000:3.0:1787784474.692859:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750023552:12345-0@lo:503: Request processed in 134us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.692866:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787784474.692980:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023552:0@lo:503: 00000040:00080000:2.0:1787784474.693254:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784474.693322:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023680:0@lo:502: 00000100:00100000:2.0:1787784474.693360:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784474.693384:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d2148480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784474.693485:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750023680 00000100:00100000:3.0:1787784474.693490:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750023680 00000100:00100000:3.0:1787784474.693516:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787784474.693523:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750023680:12345-0@lo:502: 00000100:00100000:3.0:1787784474.693606:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750023680:12345-0@lo:502: Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.693613:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787784474.693733:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023680:0@lo:502: 00000040:00080000:3.0:1787784474.694263:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787784474.694295:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787784474.694313:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787784474.694328:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787784474.694343:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787784474.694356:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787784474.694378:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023808:0@lo:502: 00000100:00100000:3.0:1787784474.694418:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784474.694456:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f527ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784474.694504:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750023808 00000100:00100000:2.0:1787784474.694509:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750023808 00000100:00100000:2.0:1787784474.694579:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787784474.694588:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750023808:12345-0@lo:502: 00000100:00100000:2.0:1787784474.694672:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750023808:12345-0@lo:502: Request processed in 85us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784474.694680:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:1.0:1787784474.694838:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784474.694848:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x88ace7295d9cab5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.694858:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:1.0:1787784474.694863:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x88ace7295d9cab5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.694873:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x88ace7295d9cab5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784474.694880:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x88ace7295d9cab5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784474.694885:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784474.694915:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x88ace7295d9cab5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.694922:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784474.694942:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x88ace7295d9cab5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.694949:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951e1d35000/0x88ace7295d9caae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x88ace7295d9cab5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.694961:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784474.694963:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784474.694964:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784474.695128:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750023808:0@lo:502: 00000040:00080000:3.0:1787784474.695187:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787784474.695196:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:1.0:1787784474.695723:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750023936:0@lo:103: 00000100:00100000:1.0:1787784474.695804:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784474.695859:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750023936 00000100:00100000:1.0:1787784474.695865:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750023936 00000100:00100000:1.0:1787784474.695904:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784474.695913:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+15:3647:x1874627750023936:12345-0@lo:103: 00010000:00010000:1.0:1787784474.695923:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784474.695939:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c151f600/0x88ace7295d9cab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9caae expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.695952:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784474.695983:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+14:3647:x1874627750023936:12345-0@lo:103: Request processed in 71us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784474.695990:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784474.696016:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750023936:0@lo:103: 00000020:01000000:3.0:1787784474.696515:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787784474.696523:0:8453:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787784474.696529:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784474.696532:0:8453:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787784474.696538:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784474.696553:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8951effe99b8) 00000020:00000080:3.0:1787784474.696702:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787784474.696710:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787784474.697113:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951efedf000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787784474.697122:0:8453:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787784474.697131:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x88ace7295d9cad1 00010000:00010000:3.0:1787784474.702208:0:8453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1787784474.702492:0:8453:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787784474.705330:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787784474.705690:0:8453:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787784474.708724:0:8453:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787784474.710748:0:8453:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787784474.716660:0:8453:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787784474.719209:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787784474.719219:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784474.719225:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784474.719228:0:8453:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787784474.719230:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784474.719234:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784474.719236:0:8453:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787784474.719238:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787784474.719240:0:8453:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787784474.719261:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784474.719264:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784474.719265:0:8453:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787784474.719268:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787784474.719409:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787784474.719437:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787784474.719457:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cac3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.719469:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cac3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784474.719477:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951efedf000 from 1 10000000:01000000:0.0:1787784474.719480:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784474.719516:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.719524:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.719535:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784474.719559:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024064:0@lo:101: 00000100:00100000:0.0:1787784474.719628:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.719673:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52af600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784474.719744:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750024064 00000100:00100000:2.0:1787784474.719751:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750024064 00000100:00100000:2.0:1787784474.719828:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787784474.719837:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+14:8429:x1874627750024064:12345-0@lo:101: 00010000:00010000:2.0:1787784474.719863:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784474.719874:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c13fee00/0x88ace7295d9cadf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cad8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.719899:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c13fee00/0x88ace7295d9cadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cad8 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.719910:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c13fee00/0x88ace7295d9cadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cad8 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.719919:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c13fee00, rc 0) 00000100:00100000:2.0:1787784474.719958:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750024064:12345-0@lo:101: Request processed in 122us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784474.719965:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787784474.720208:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024064:0@lo:101: 00010000:00010000:0.0:1787784474.720222:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cadf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.720231:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cadf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784474.720316:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024192:0@lo:501: 00000100:00100000:0.0:1787784474.720343:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.720370:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52af600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784474.720467:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750024192 00000100:00100000:2.0:1787784474.720471:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750024192 00000100:00100000:2.0:1787784474.720497:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787784474.720503:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750024192:12345-0@lo:501: 00000100:00100000:2.0:1787784474.720586:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750024192:12345-0@lo:501: Request processed in 82us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784474.720593:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787784474.720657:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024192:0@lo:501: 00000100:00100000:0.0:1787784474.720681:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024320:0@lo:503: 00000100:00100000:0.0:1787784474.720722:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.720744:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52af600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784474.720891:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750024320 00000100:00100000:2.0:1787784474.720895:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750024320 00000100:00100000:2.0:1787784474.720923:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787784474.720930:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750024320:12345-0@lo:503: 00000100:00100000:2.0:1787784474.721013:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750024320:12345-0@lo:503: Request processed in 82us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784474.721020:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787784474.721135:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024320:0@lo:503: 00000040:00080000:0.0:1787784474.721392:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787784474.721471:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024448:0@lo:502: 00000100:00100000:0.0:1787784474.721511:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.721542:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52afb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784474.721591:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750024448 00000100:00100000:3.0:1787784474.721596:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750024448 00000100:00100000:3.0:1787784474.721625:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787784474.721632:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:8429:x1874627750024448:12345-0@lo:502: 00000100:00100000:3.0:1787784474.721708:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:8429:x1874627750024448:12345-0@lo:502: Request processed in 76us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.721715:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787784474.721966:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024448:0@lo:502: 00000040:00080000:0.0:1787784474.722250:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787784474.722275:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787784474.722297:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024576:0@lo:502: 00000100:00100000:0.0:1787784474.722339:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.722369:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d21793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784474.722422:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750024576 00000100:00100000:3.0:1787784474.722426:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750024576 00000100:00100000:3.0:1787784474.722461:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787784474.722468:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750024576:12345-0@lo:502: 00000100:00100000:3.0:1787784474.722541:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750024576:12345-0@lo:502: Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.722555:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787784474.722630:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024576:0@lo:502: 00000040:00080000:0.0:1787784474.722665:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787784474.722672:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787784474.728122:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784474.728138:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784474.728140:0:8456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787784474.728149:0:8456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951efedf000 00000020:00000080:2.0:1787784474.728151:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784474.728177:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784474.728180:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784474.728181:0:8456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787784474.728185:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787784474.730393:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787784474.730434:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787784474.730458:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cadf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.730480:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cadf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784474.730539:0:8429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787784474.730543:0:8429:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8951efedf000 10000000:01000000:0.0:1787784474.730546:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8951efedf000 10000000:01000000:0.0:1787784474.730549:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787784474.730555:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951efedf000 from 1 10000000:01000000:0.0:1787784474.730558:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787784474.730596:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.730605:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.730616:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784474.730643:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024704:0@lo:101: 00000100:00100000:0.0:1787784474.730714:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.730948:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d21793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784474.731528:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750024704 00000100:00100000:2.0:1787784474.731535:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750024704 00000100:00100000:2.0:1787784474.731621:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787784474.731630:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8429:x1874627750024704:12345-0@lo:101: 00010000:00010000:2.0:1787784474.731645:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784474.731661:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c13ff000/0x88ace7295d9caed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cae6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.731686:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c13ff000/0x88ace7295d9caed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cae6 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.731696:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c13ff000/0x88ace7295d9caed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cae6 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.731705:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c13ff000, rc 0) 00000100:00100000:2.0:1787784474.731838:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:8429:x1874627750024704:12345-0@lo:101: Request processed in 208us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784474.731845:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787784474.732131:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024704:0@lo:101: 00010000:00010000:0.0:1787784474.732148:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9caed expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.732167:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9caed expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784474.732269:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024832:0@lo:501: 00000100:00100000:0.0:1787784474.732299:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.732366:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d21793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784474.732400:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750024832 00000100:00100000:2.0:1787784474.732405:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750024832 00000100:00100000:2.0:1787784474.732435:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787784474.732442:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:8429:x1874627750024832:12345-0@lo:501: 00000100:00100000:2.0:1787784474.732552:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:8429:x1874627750024832:12345-0@lo:501: Request processed in 110us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784474.732559:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787784474.732617:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024832:0@lo:501: 00000100:00100000:0.0:1787784474.732642:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024960:0@lo:503: 00000100:00100000:0.0:1787784474.732680:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.732700:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d21793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784474.732742:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750024960 00000100:00100000:3.0:1787784474.732747:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750024960 00000100:00100000:3.0:1787784474.732803:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787784474.732919:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:8429:x1874627750024960:12345-0@lo:503: 00000100:00100000:3.0:1787784474.733007:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:8429:x1874627750024960:12345-0@lo:503: Request processed in 197us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.733014:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787784474.733224:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750024960:0@lo:503: 00000040:00080000:0.0:1787784474.733454:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787784474.733514:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750025088:0@lo:502: 00000100:00100000:0.0:1787784474.733550:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.733567:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d21793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784474.733617:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750025088 00000100:00100000:3.0:1787784474.733621:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750025088 00000100:00100000:3.0:1787784474.733639:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787784474.733646:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:8429:x1874627750025088:12345-0@lo:502: 00000100:00100000:3.0:1787784474.733731:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:8429:x1874627750025088:12345-0@lo:502: Request processed in 84us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.733737:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787784474.733924:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750025088:0@lo:502: 00000040:00080000:0.0:1787784474.734259:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787784474.734287:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787784474.734301:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787784474.734331:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787784474.734347:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787784474.734359:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787784474.734369:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787784474.734381:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787784474.734394:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787784474.734408:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787784474.734421:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787784474.734433:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787784474.734446:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787784474.734472:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787784474.734487:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787784474.734501:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787784474.734515:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787784474.734529:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787784474.734544:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787784474.734571:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787784474.734587:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787784474.734602:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787784474.734616:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787784474.734631:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787784474.734646:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787784474.734659:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787784474.734673:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787784474.734687:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787784474.734700:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787784474.734710:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787784474.734721:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787784474.734732:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787784474.734744:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787784474.734757:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787784474.735136:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787784474.735181:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787784474.735194:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1787784474.735227:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750025216:0@lo:502: 00000100:00100000:0.0:1787784474.735282:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.735357:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d21793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784474.735398:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750025216 00000100:00100000:3.0:1787784474.735405:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750025216 00000100:00100000:3.0:1787784474.735485:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787784474.735495:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:8429:x1874627750025216:12345-0@lo:502: 00000100:00100000:3.0:1787784474.735617:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:8429:x1874627750025216:12345-0@lo:502: Request processed in 123us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.735626:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787784474.735705:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750025216:0@lo:502: 00000040:00080000:0.0:1787784474.735748:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787784474.735758:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787784474.736569:0:8458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787784474.736602:0:8458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8950c20ccd28) 00000020:00000080:0.0:1787784474.736627:0:8458:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787784474.736727:0:8458:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951efedf000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787784474.736731:0:8458:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951efedf000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787784474.736734:0:8458:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951efedf000 3 00010000:00080000:0.0:1787784474.737001:0:8458:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c20de000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1787784474.740257:0:8458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1787784474.741368:0:8458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787784474.741416:0:8458:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787784474.741429:0:8458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x88ace7295d9cafb 00000100:00080000:0.0:1787784474.741441:0:8458:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784474.741447:0:8458:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8950c20de000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784474.741486:0:8458:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951e1eae940 x1874627750025344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784474.741511:0:8458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787784474.741743:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750025472:0@lo:400: 00000100:00100000:0.0:1787784474.741914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.741954:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784474.741961:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750025600:0@lo:400: 00000100:00100000:0.0:1787784474.741990:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.742022:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750025600 00000100:00100000:0.0:1787784474.742098:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750025600 00000100:00100000:0.0:1787784474.742168:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787784474.742178:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750025600:12345-0@lo:400: 00000100:00100000:0.0:1787784474.742234:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750025600:12345-0@lo:400: Request processed in 58us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784474.742241:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787784474.742284:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750025600:0@lo:400: 00000100:00100000:2.0:1787784474.742368:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750025472 00000100:00100000:2.0:1787784474.742374:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750025472 00000100:00100000:2.0:1787784474.742408:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787784474.742416:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1196580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750025472:12345-0@lo:400: 00000100:00100000:2.0:1787784474.742461:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1196580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750025472:12345-0@lo:400: Request processed in 46us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784474.742467:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787784474.742498:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8950c19f6580 x1874627750025472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784474.742509:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750025472:0@lo:400: 00000100:00100000:3.0:1787784474.742588:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874627750025344:0@lo:38: 00000100:00100000:3.0:1787784474.742622:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784474.742666:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750025344 00000100:00100000:3.0:1787784474.742670:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750025344 00000100:00100000:3.0:1787784474.742703:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784474.742707:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874627750025344:12345-0@lo:38: 00010000:00080000:3.0:1787784474.742730:0:7991:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:3.0:1787784474.742793:0:7991:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x88ace7295d9cb02 00000004:00100000:3.0:1787784474.742882:0:7991:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787784474.742916:0:7991:0:(import.c:65:import_set_state_nolock()) ffff895201ca4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784474.742958:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874627750025344:12345-0@lo:38: Request processed in 249us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.742964:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787784474.743116:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951e1eae940 x1874627750025344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784474.743125:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784474.743130:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787784474.743137:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787784474.743141:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787784474.743143:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c20de000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787784474.743148:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874627750025344:0@lo:38: 00000100:00100000:1.0:1787784474.743470:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750025856:0@lo:400: 00000100:00100000:1.0:1787784474.743510:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784474.743536:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784474.743542:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750025728:0@lo:400: 00000100:00100000:1.0:1787784474.743560:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784474.743583:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750025728 00000100:00100000:1.0:1787784474.743587:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750025728 00000100:00100000:1.0:1787784474.743615:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784474.743621:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750025728:12345-0@lo:400: 00000100:00100000:1.0:1787784474.743653:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750025728:12345-0@lo:400: Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784474.743659:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787784474.743681:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8950c19f61c0 x1874627750025728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784474.743692:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750025728:0@lo:400: 00000100:00100000:0.0:1787784474.744927:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750025856 00000100:00100000:0.0:1787784474.744936:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750025856 00000100:00100000:0.0:1787784474.744978:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787784474.744986:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750025856:12345-0@lo:400: 00000100:00100000:0.0:1787784474.745067:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750025856:12345-0@lo:400: Request processed in 82us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784474.745074:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787784474.745240:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750025856:0@lo:400: 00000020:01000004:0.0:1787784474.746248:0:8458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787784474.746262:0:8458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8950c20c8000) 00000020:00000080:0.0:1787784474.746285:0:8458:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1787784474.746358:0:8458:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951efedf000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787784474.746362:0:8458:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951efedf000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787784474.746364:0:8458:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951efedf000 3 00010000:00080000:0.0:1787784474.746394:0:8458:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c20df800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1787784474.751794:0:8458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1787784474.752670:0:8458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787784474.752729:0:8458:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787784474.752742:0:8458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x88ace7295d9cb10 00000100:00080000:0.0:1787784474.752754:0:8458:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784474.752760:0:8458:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8950c20df800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784474.752838:0:8458:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951f5291e00 x1874627750025984/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784474.752865:0:8458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787784474.753280:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750026112:0@lo:400: 00000100:00100000:0.0:1787784474.753436:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.753479:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2362940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750026624:0@lo:400: 00000100:00100000:0.0:1787784474.753506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.753538:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787784474.753544:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750026240:0@lo:400: 00000100:00100000:0.0:1787784474.753566:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.753583:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750026752:0@lo:400: 00000100:00100000:0.0:1787784474.753608:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.753638:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750026624 00000100:00100000:0.0:1787784474.753644:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750026624 00000100:00100000:3.0:1787784474.753747:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750026240 00000100:00100000:3.0:1787784474.753752:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750026240 00000100:00100000:3.0:1787784474.753796:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750026752 00000100:00100000:3.0:1787784474.753799:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750026752 00000100:00100000:3.0:1787784474.753844:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784474.753854:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750026240:12345-0@lo:400: 00000100:00100000:3.0:1787784474.754116:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750026240:12345-0@lo:400: Request processed in 263us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.754125:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784474.754142:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784474.754149:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2361e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750026752:12345-0@lo:400: 00000100:00100000:3.0:1787784474.754191:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2361e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750026752:12345-0@lo:400: Request processed in 43us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.754198:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787784474.754218:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787784474.754249:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951f5292d00 x1874627750026240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784474.754262:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750026240:0@lo:400: 00010000:00080000:3.0:1787784474.754283:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8950c2363c00 x1874627750026752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784474.754291:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750026752:0@lo:400: 00000100:00100000:2.0:1787784474.755384:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874627750025984:0@lo:38: 00000100:00100000:2.0:1787784474.755433:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.755643:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787784474.755657:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750026624:12345-0@lo:400: 00000100:00100000:0.0:1787784474.755719:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750026624:12345-0@lo:400: Request processed in 67us (2212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784474.755726:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787784474.755752:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750025984 00000100:00100000:0.0:1787784474.755757:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750025984 00000100:00100000:0.0:1787784474.755800:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784474.755805:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874627750025984:12345-0@lo:38: 00010000:00080000:0.0:1787784474.756144:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1787784474.756200:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x88ace7295d9cb17 00000004:00100000:0.0:1787784474.756215:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787784474.756243:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8950c20dc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784474.756291:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874627750025984:12345-0@lo:38: Request processed in 484us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784474.756298:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787784474.756444:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951f5291e00 x1874627750025984/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784474.756466:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784474.756474:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787784474.756482:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787784474.756487:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787784474.756489:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c20df800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787784474.756494:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874627750025984:0@lo:38: 00000100:00100000:1.0:1787784474.756593:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750026368:0@lo:400: 00000100:00100000:1.0:1787784474.756629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784474.756662:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784474.756669:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750026496:0@lo:400: 00000100:00100000:1.0:1787784474.756703:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784474.757042:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750026496 00000100:00100000:1.0:1787784474.757047:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750026496 00000100:00100000:1.0:1787784474.757074:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787784474.757081:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750026496:12345-0@lo:400: 00000100:00100000:1.0:1787784474.757125:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750026496:12345-0@lo:400: Request processed in 44us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784474.757142:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787784474.757183:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951f5293480 x1874627750026496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784474.757192:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750026496:0@lo:400: 00000100:00100000:1.0:1787784474.757214:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750026112 00000100:00100000:1.0:1787784474.757217:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750026112 00000100:00100000:1.0:1787784474.757242:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787784474.757249:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:3644:x1874627750026112:12345-0@lo:400: 00000100:00100000:1.0:1787784474.757283:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:3644:x1874627750026112:12345-0@lo:400: Request processed in 35us (3849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784474.757290:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787784474.758938:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750026368 00000100:00100000:0.0:1787784474.758949:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750026368 00000100:00100000:0.0:1787784474.759000:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787784474.759010:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750026368:12345-0@lo:400: 00000100:00100000:0.0:1787784474.759109:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750026368:12345-0@lo:400: Request processed in 100us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784474.759117:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000040:00080000:0.0:1787784474.759248:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1787784474.760003:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750026112:0@lo:400: 00000100:00100000:2.0:1787784474.760021:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2362940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750026624:0@lo:400: 00000100:00100000:1.0:1787784474.760152:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750026368:0@lo:400: 00000020:01000000:1.0:1787784474.760184:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787784474.760215:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787784474.760238:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9caed expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.760250:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9caed expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787784474.760298:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787784474.760300:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787784474.760301:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784474.760303:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784474.760304:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784474.760305:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784474.760307:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784474.760308:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787784474.760310:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787784474.760317:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784474.760319:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784474.760322:0:8429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787784474.761181:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787784474.761183:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787784474.761184:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784474.761186:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784474.761187:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784474.761189:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784474.761190:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784474.761191:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787784474.761192:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787784474.761194:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784474.761195:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784474.761221:0:8429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787784474.761237:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750026880:0@lo:253: 00000100:00100000:1.0:1787784474.761298:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784474.761795:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750026880 00000100:00100000:2.0:1787784474.761803:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750026880 00000100:00100000:2.0:1787784474.761859:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787784474.761868:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:8429:x1874627750026880:12345-0@lo:253: 20000000:01000000:2.0:1787784474.762113:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787784474.762128:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787784474.762320:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247cc0 going to sleep for 11 seconds 20000000:01000000:2.0:1787784474.778131:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787784474.778150:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787784474.778273:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787784474.778278:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787784474.778301:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.778319:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ca14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca0d expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.778339:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ca30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca29 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.778346:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.778387:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ca30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ca29 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.778400:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ca30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ca29 expref: 16 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784474.778415:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750027008:0@lo:104: 00000100:00100000:0.0:1787784474.778483:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784474.778535:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ca14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ca0d expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.778544:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ca14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ca0d expref: 16 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784474.778563:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2362d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750027136:0@lo:104: 00000100:00100000:0.0:1787784474.778582:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fb39fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784474.778879:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787784474.778909:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784474.778935:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750027008 00000100:00100000:3.0:1787784474.778942:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750027008 00000100:00100000:3.0:1787784474.778976:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750027136 00000100:00100000:3.0:1787784474.778979:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750027136 00000100:00100000:3.0:1787784474.778993:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787784474.779002:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb303850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:6537:x1874627750027008:12345-0@lo:104: 00010000:00010000:3.0:1787784474.779013:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9ca29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca30 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.779236:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784474.779242:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb303850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:6537:x1874627750027008:12345-0@lo:104: Request processed in 242us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.779250:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787784474.779288:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787784474.779294:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5317840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:6537:x1874627750027136:12345-0@lo:104: 00010000:00010000:3.0:1787784474.779303:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9ca0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca14 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.779486:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784474.779493:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9ca29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca30 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.779501:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784474.779505:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9ca29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ca30 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.779513:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9ca29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ca30 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784474.779534:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9ca29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ca30 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784474.779540:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784474.779571:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9ca29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca30 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.779578:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784474.779602:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9ca29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca30 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.779610:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9ca29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca30 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784474.779625:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784474.779627:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784474.779629:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784474.779907:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750027264:0@lo:103: 00000100:00100000:0.0:1787784474.779956:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750027008:0@lo:104: 00000100:00100000:0.0:1787784474.779966:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2362d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750027136:0@lo:104: 00010000:00010000:0.0:1787784474.779986:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784474.780339:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784474.780348:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5317840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:6537:x1874627750027136:12345-0@lo:104: Request processed in 1053us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784474.780356:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784474.780573:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:8429:x1874627750026880:12345-0@lo:253: Request processed in 18705us (19273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784474.780583:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787784474.780703:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:8429:1874627750026880:0@lo:253: 10000000:01000000:3.0:1787784474.780713:0:8429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787784474.780716:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787784474.780717:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787784474.780719:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784474.780720:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784474.780721:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784474.780723:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784474.780724:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787784474.780725:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787784474.780727:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787784474.780728:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784474.780730:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787784474.780739:0:8429:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1787784474.781287:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784474.781296:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9ca0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca14 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.781305:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784474.781308:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9ca0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ca14 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.781317:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9ca0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ca14 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784474.781333:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9ca0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ca14 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784474.781339:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784474.781376:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9ca0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca14 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.781382:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784474.781392:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9ca0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca14 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.781413:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9ca0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca14 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.781430:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784474.781432:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784474.781433:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784474.783846:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2362d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750027392:0@lo:103: 00000100:00100000:0.0:1787784474.783924:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784474.784396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784474.785146:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750027392 00000100:00100000:0.0:1787784474.785167:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750027392 00010000:00010000:0.0:1787784474.785203:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ca14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca0d expref: 16 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784474.785217:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750027264 00000100:00100000:1.0:1787784474.785222:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750027264 00000100:00100000:0.0:1787784474.785236:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1787784474.785237:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ca30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca29 expref: 17 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784474.785244:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+17:3647:x1874627750027392:12345-0@lo:103: 00000100:00100000:1.0:1787784474.785256:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787784474.785257:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787784474.785261:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+17:3646:x1874627750027264:12345-0@lo:103: 00010000:00010000:0.0:1787784474.785262:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ca14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca0d expref: 17 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.785268:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784474.785271:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ca30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca29 expref: 17 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.785274:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ca14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ca0d expref: 17 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.785283:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ca30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ca29 expref: 17 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1787784474.787185:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787784474.787339:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787784474.787510:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787784474.787644:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787784474.788565:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787784474.789123:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:0.0:1787784474.790228:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ca14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ca0d expref: 17 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784474.790250:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784474.790666:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ca30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ca29 expref: 16 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.790680:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.790689:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787784474.790706:0:8452:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012428030s 00010000:00010000:1.0:1787784474.790712:0:8452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.790719:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.790726:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.790733:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.790740:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784474.790744:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.790753:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.790784:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.790823:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784474.790869:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+15:3646:x1874627750027264:12345-0@lo:103: Request processed in 5604us (6470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784474.790879:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787784474.790925:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.790933:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784474.790940:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629e00/0x88ace7295d9cb1e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784474.790979:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750027264:0@lo:103: 00000100:00100000:0.0:1787784474.791203:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+14:3647:x1874627750027392:12345-0@lo:103: Request processed in 5957us (7277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784474.791220:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784474.791265:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2362d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750027392:0@lo:103: 00000001:00000004:2.0:1787784474.792079:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787784474.801739:0:8429:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787784474.801750:0:8429:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787784474.802107:0:8429:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787784474.802163:0:8429:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787784474.802181:0:8429:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787784474.802200:0:8429:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787784474.803177:0:8429:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784474.804574:0:8429:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787784475.141922:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787784475.636356:0:8514:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787784475.637233:0:8514:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787784475.782071:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2362d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750027520:0@lo:41: 00000100:00100000:3.0:1787784475.782152:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784475.782261:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750027520 00000100:00100000:0.0:1787784475.782269:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750027520 00000100:00100000:0.0:1787784475.782322:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787784475.782332:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5315680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750027520:12345-0@lo:41: 00000004:00000024:0.0:1787784475.782365:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1787784475.782414:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5315680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750027520:12345-0@lo:41: Request processed in 84us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784475.782422:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787784475.782504:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2362d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750027520:0@lo:41: 00010000:00010000:0.0:1787784476.168726:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784477.189998:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784478.214312:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784478.854477:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784478.854505:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750027648:0@lo:41: 00000100:00100000:2.0:1787784478.854579:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784478.854733:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750027648 00000100:00100000:0.0:1787784478.854742:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750027648 00000100:00100000:0.0:1787784478.854829:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787784478.854839:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750027648:12345-0@lo:41: 00000004:00000024:0.0:1787784478.854874:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787784478.854925:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750027648:12345-0@lo:41: Request processed in 88us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784478.854933:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787784478.854977:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750027648:0@lo:41: 00010000:00010000:0.0:1787784479.237943:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784479.881069:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750028032:0@lo:400: 00000100:00100000:2.0:1787784479.881160:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784479.881212:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750028544:0@lo:400: 00000100:00100000:2.0:1787784479.881233:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784479.881255:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784479.881259:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750028160:0@lo:400: 00000100:00100000:2.0:1787784479.881275:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784479.881309:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750028032 00000100:00100000:2.0:1787784479.881316:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750028032 00000100:00100000:2.0:1787784479.881363:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787784479.881371:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750028032:12345-0@lo:400: 00000100:00100000:2.0:1787784479.881419:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750028032:12345-0@lo:400: Request processed in 48us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784479.881427:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787784479.881446:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750028544 00000100:00100000:2.0:1787784479.881449:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750028544 00000100:00100000:2.0:1787784479.881477:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750028160 00000100:00100000:2.0:1787784479.881479:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750028160 00000100:00100000:2.0:1787784479.881492:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787784479.881497:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750028544:12345-0@lo:400: 00000100:00100000:2.0:1787784479.881521:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750028544:12345-0@lo:400: Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784479.881527:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787784479.881535:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787784479.881540:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750028160:12345-0@lo:400: 00000100:00100000:1.0:1787784479.881678:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750027776:0@lo:400: 00000100:00100000:1.0:1787784479.881709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784479.881731:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750028288:0@lo:400: 00000100:00100000:1.0:1787784479.881748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784479.881762:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787784479.881788:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750027904:0@lo:400: 00000100:00100000:1.0:1787784479.881806:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784479.881814:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750028416:0@lo:400: 00000100:00100000:1.0:1787784479.881833:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784479.881849:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750027904 00000100:00100000:1.0:1787784479.881851:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750027904 00000100:00100000:1.0:1787784479.881867:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750028416 00000100:00100000:1.0:1787784479.881869:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750028416 00000100:00100000:1.0:1787784479.881888:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787784479.881893:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750027904:12345-0@lo:400: 00000100:00100000:1.0:1787784479.881922:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750027904:12345-0@lo:400: Request processed in 29us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784479.881928:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787784479.881937:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784479.881942:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750028416:12345-0@lo:400: 00000100:00100000:1.0:1787784479.881962:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750028416:12345-0@lo:400: Request processed in 20us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784479.881967:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784479.881981:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750027776 00000100:00100000:1.0:1787784479.881983:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750027776 00000100:00100000:1.0:1787784479.882002:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787784479.882007:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+14:3646:x1874627750027776:12345-0@lo:400: 00000100:00100000:1.0:1787784479.882028:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+14:3646:x1874627750027776:12345-0@lo:400: Request processed in 21us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784479.882033:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787784479.882055:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750028288 00000100:00100000:1.0:1787784479.882058:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750028288 00000100:00100000:1.0:1787784479.882069:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787784479.882073:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750028288:12345-0@lo:400: 00000100:00100000:1.0:1787784479.882095:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750028288:12345-0@lo:400: Request processed in 22us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784479.882101:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1787784479.882143:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f4b40 x1874627750027904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784479.882157:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750027904:0@lo:400: 00010000:00080000:1.0:1787784479.882173:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f6d00 x1874627750028416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784479.882182:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750028416:0@lo:400: 00000100:00100000:1.0:1787784479.882189:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750027776:0@lo:400: 00000100:00100000:1.0:1787784479.882196:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750028288:0@lo:400: 00000100:00100000:2.0:1787784479.882388:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750028160:12345-0@lo:400: Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784479.882396:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787784479.882429:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f5e00 x1874627750028160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784479.882438:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750028160:0@lo:400: 00000100:00100000:2.0:1787784479.882448:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750028032:0@lo:400: 00010000:00080000:2.0:1787784479.882456:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f5a40 x1874627750028544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784479.882463:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750028544:0@lo:400: 00000100:00080000:3.0:1787784479.883219:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784479.883227:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787784480.262797:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784480.902322:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784480.902363:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750028672:0@lo:41: 00000100:00100000:0.0:1787784480.902445:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784480.902650:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750028672 00000100:00100000:1.0:1787784480.902670:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750028672 00000100:00100000:1.0:1787784480.902726:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784480.902737:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750028672:12345-0@lo:41: 00000004:00000024:1.0:1787784480.902792:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1787784480.902849:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750028672:12345-0@lo:41: Request processed in 113us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784480.902856:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784480.902902:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750028672:0@lo:41: 00010000:00010000:0.0:1787784481.286328:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787784481.636545:0:8804:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787784482.310024:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787784482.732612:0:8856:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787784482.733184:0:8856:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787784483.337690:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787784483.974321:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787784483.974329:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951cfe95800 from 30 10000000:01000000:2.0:1787784483.974335:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787784483.974372:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784483.974383:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784483.974395:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784483.974419:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750028928:0@lo:101: 00000100:00100000:2.0:1787784483.974498:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784483.974563:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fb39f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784483.974701:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750028928 00000100:00100000:0.0:1787784483.974710:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750028928 00000100:00100000:0.0:1787784483.974790:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787784483.974801:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+14:6518:x1874627750028928:12345-0@lo:101: 00010000:00010000:0.0:1787784483.974814:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784483.974831:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1629200/0x88ace7295d9cb2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cb25 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784483.974856:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629200/0x88ace7295d9cb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cb25 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784483.974866:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1629200/0x88ace7295d9cb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cb25 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784483.974875:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629200, rc 0) 00000100:00100000:0.0:1787784483.974916:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750028928:12345-0@lo:101: Request processed in 118us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784483.974923:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787784483.974969:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750028928:0@lo:101: 00010000:00010000:0.0:1787784483.974984:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb2c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784483.974993:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cb2c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784483.975080:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750029056:0@lo:501: 00000100:00100000:0.0:1787784483.975107:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784483.975130:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784483.975142:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750029056 00000100:00100000:0.0:1787784483.975145:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750029056 00000100:00100000:0.0:1787784483.975168:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787784483.975175:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750029056:12345-0@lo:501: 00000100:00100000:0.0:1787784483.975371:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750029056:12345-0@lo:501: Request processed in 128us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784483.975379:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787784483.975412:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750029056:0@lo:501: 00000100:00100000:0.0:1787784483.975440:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750029184:0@lo:503: 00000100:00100000:0.0:1787784483.975482:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784483.975497:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784483.975507:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750029184 00000100:00100000:0.0:1787784483.975510:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750029184 00000100:00100000:0.0:1787784483.975530:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787784483.975535:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750029184:12345-0@lo:503: 00000100:00100000:0.0:1787784483.975616:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750029184:12345-0@lo:503: Request processed in 80us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784483.975622:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787784483.975664:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750029184:0@lo:503: 00000100:00100000:3.0:1787784483.975967:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784483.975981:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750028800:0@lo:41: 00000100:00100000:3.0:1787784483.976015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784483.976795:0:8908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8908:1874627750029312:0@lo:502: 00000100:00100000:2.0:1787784483.976860:0:8908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784483.976897:0:8908:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fb39f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787784483.976953:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750029312 00000100:00100000:1.0:1787784483.976959:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750029312 00000100:00100000:1.0:1787784483.977001:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787784483.977019:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:8908:x1874627750029312:12345-0@lo:502: 00000100:00100000:1.0:1787784483.977156:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:8908:x1874627750029312:12345-0@lo:502: Request processed in 145us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784483.977163:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787784483.977320:0:8908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8908:1874627750029312:0@lo:502: 00000100:00100000:3.0:1787784483.977372:0:8908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8908:1874627750029440:0@lo:502: 00000100:00100000:3.0:1787784483.977407:0:8908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784483.977428:0:8908:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d09540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784483.977598:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750029440 00000100:00100000:1.0:1787784483.977603:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750029440 00000100:00100000:1.0:1787784483.977643:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787784483.977650:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8908:x1874627750029440:12345-0@lo:502: 00000100:00100000:1.0:1787784483.977714:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:8908:x1874627750029440:12345-0@lo:502: Request processed in 63us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784483.977721:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787784483.977934:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750028800 00000100:00100000:0.0:1787784483.977939:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750028800 00000100:00100000:0.0:1787784483.977986:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787784483.977993:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750028800:12345-0@lo:41: 00000004:00000024:0.0:1787784483.978019:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787784483.978176:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750028800:12345-0@lo:41: Request processed in 183us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784483.978183:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787784483.980270:0:8908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8908:1874627750029440:0@lo:502: 00000040:00080000:3.0:1787784483.980334:0:8908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787784483.980897:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787784483.980919:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787784483.980931:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb2c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784483.980943:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb2c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784483.980953:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787784483.980956:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951cfe95800 from 5 10000000:01000000:0.0:1787784483.980959:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787784483.980999:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784483.981006:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784483.981016:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784483.981035:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750029568:0@lo:101: 00000100:00100000:0.0:1787784483.981119:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784483.981165:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784483.981298:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750029568 00000100:00100000:2.0:1787784483.981312:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750029568 00000100:00100000:2.0:1787784483.981364:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787784483.981375:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750029568:12345-0@lo:101: 00010000:00010000:2.0:1787784483.981389:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784483.981402:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c13fec00/0x88ace7295d9cb3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cb33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784483.981423:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c13fec00/0x88ace7295d9cb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cb33 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784483.981433:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c13fec00/0x88ace7295d9cb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cb33 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784483.981441:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c13fec00, rc 0) 00000100:00100000:2.0:1787784483.981483:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750029568:12345-0@lo:101: Request processed in 111us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784483.981491:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787784483.985612:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750029568:0@lo:101: 00010000:00010000:3.0:1787784483.985644:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb3a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784483.985655:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cb3a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784483.985742:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750029696:0@lo:256: 00000100:00100000:3.0:1787784483.985840:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784483.985881:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d09540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784483.986894:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750029696 00000100:00100000:2.0:1787784483.986904:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750029696 00000100:00100000:2.0:1787784483.986967:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787784483.986977:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750029696:12345-0@lo:256: 20000000:01000000:2.0:1787784483.987000:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787784483.987020:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787784483.987023:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787784483.987152:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750029696:12345-0@lo:256: Request processed in 176us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784483.987167:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787784483.987294:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750029696:0@lo:256: 10000000:01000000:0.0:1787784483.987360:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787784483.987369:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb3a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784483.987381:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb3a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784483.987390:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787784483.987393:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1787784483.987396:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787784483.987423:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784483.987432:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784483.987442:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784483.987458:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750029824:0@lo:101: 00000100:00100000:0.0:1787784483.987490:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784483.987527:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784483.987808:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750029824 00000100:00100000:2.0:1787784483.987813:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750029824 00000100:00100000:2.0:1787784483.987839:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787784483.987846:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750029824:12345-0@lo:101: 00010000:00010000:2.0:1787784483.987854:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784483.987880:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5a200/0x88ace7295d9cb48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cb41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784483.987902:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5a200/0x88ace7295d9cb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cb41 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784483.987912:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5a200/0x88ace7295d9cb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cb41 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784483.987921:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a200, rc 0) 00000100:00100000:2.0:1787784483.987951:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750029824:12345-0@lo:101: Request processed in 105us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784483.987957:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787784483.989618:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750029824:0@lo:101: 00010000:00010000:0.0:1787784483.989644:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb48 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784483.989655:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cb48 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784483.989730:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750029952:0@lo:501: 00000100:00100000:0.0:1787784483.989835:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784483.989867:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784483.989928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750029952 00000100:00100000:2.0:1787784483.989934:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750029952 00000100:00100000:2.0:1787784483.989969:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787784483.989978:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750029952:12345-0@lo:501: 00000100:00100000:2.0:1787784483.990124:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750029952:12345-0@lo:501: Request processed in 145us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784483.990132:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787784483.990263:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750029952:0@lo:501: 00000100:00100000:0.0:1787784483.990290:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750030080:0@lo:503: 00000100:00100000:0.0:1787784483.990333:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784483.990357:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784483.990450:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750030080 00000100:00100000:2.0:1787784483.990462:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750030080 00000100:00100000:2.0:1787784483.990494:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787784483.990500:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750030080:12345-0@lo:503: 00000100:00100000:2.0:1787784483.990589:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750030080:12345-0@lo:503: Request processed in 88us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784483.990595:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787784483.990666:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750030080:0@lo:503: 00000100:00100000:3.0:1787784483.991124:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8909:1874627750030208:0@lo:502: 00000100:00100000:3.0:1787784483.991156:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784483.991184:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d09300 going to sleep for 11 seconds 00000100:00100000:2.0:1787784483.991225:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750030208 00000100:00100000:2.0:1787784483.991229:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750030208 00000100:00100000:2.0:1787784483.991265:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787784483.991271:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:8909:x1874627750030208:12345-0@lo:502: 00000100:00100000:2.0:1787784483.991348:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:8909:x1874627750030208:12345-0@lo:502: Request processed in 76us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784483.991354:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787784483.991507:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8909:1874627750030208:0@lo:502: 00000020:01000000:3.0:1787784483.991529:0:8909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787784483.991538:0:8909:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787784483.991544:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784483.991546:0:8909:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787784483.991550:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787784483.991553:0:8909:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:3.0:1787784483.991582:0:8909:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787784483.991586:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784483.991601:0:8909:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8951effeb370) 00000020:00000080:3.0:1787784483.991623:0:8909:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1787784483.991628:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787784483.991713:0:8909:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787784483.991718:0:8909:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787784483.991725:0:8909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9cb56 00010000:00080000:3.0:1787784483.991753:0:8909:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951f67db000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1787784483.992015:0:8909:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000100:00100000:1.0:1787784483.992847:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750028800:0@lo:41: 00000040:01000000:3.0:1787784484.005693:0:8909:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787784484.005720:0:8909:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787784484.006223:0:8909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784484.006441:0:8909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784484.007171:0:8909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787784484.007259:0:8909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787784484.007699:0:8910:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787784484.007704:0:8910:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787784484.008494:0:8909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787784484.008505:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787784484.008540:0:8909:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787784484.008562:0:8909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9cb5d 00000100:00080000:2.0:1787784484.008573:0:8909:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784484.008579:0:8909:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8951f67db000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784484.008611:0:8909:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c19f5e00 x1874627750030336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784484.008669:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750030336:0@lo:8: 00000100:00100000:3.0:1787784484.008757:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787784484.009130:0:8909:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787784484.009199:0:8909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784484.009204:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784484.009206:0:8909:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787784484.009218:0:8909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784484.009221:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784484.009222:0:8909:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784484.009225:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784484.009227:0:8909:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787784484.009250:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8909:1874627750030464:0@lo:502: 00000100:00100000:2.0:1787784484.009296:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784484.009323:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750030464 00000100:00100000:2.0:1787784484.009329:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750030464 00000100:00100000:2.0:1787784484.009371:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787784484.009379:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:8909:x1874627750030464:12345-0@lo:502: 00000100:00100000:2.0:1787784484.009496:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:8909:x1874627750030464:12345-0@lo:502: Request processed in 117us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784484.009504:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787784484.009540:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784484.009560:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8909:1874627750030464:0@lo:502: 00000020:01000000:2.0:1787784484.009583:0:8909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784484.009587:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784484.009588:0:8909:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787784484.009592:0:8909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1787784484.009639:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1787784484.009658:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787784484.009668:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb48 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.009678:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb48 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784484.009688:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787784484.009698:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951d08ed800 from 30 10000000:01000000:2.0:1787784484.009701:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787784484.009724:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.009746:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.009755:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784484.009785:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750030592:0@lo:101: 00000100:00100000:2.0:1787784484.009811:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784484.009826:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784484.009839:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750030592 00000100:00100000:2.0:1787784484.009842:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750030592 00000100:00100000:2.0:1787784484.009863:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787784484.009869:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750030592:12345-0@lo:101: 00010000:00010000:2.0:1787784484.009877:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784484.009901:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5a000/0x88ace7295d9cb6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cb64 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.009922:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5a000/0x88ace7295d9cb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cb64 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.009932:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5a000/0x88ace7295d9cb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cb64 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.009941:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a000, rc 0) 00000100:00100000:2.0:1787784484.009965:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750030592:12345-0@lo:101: Request processed in 96us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784484.009976:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787784484.010006:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750030592:0@lo:101: 00010000:00010000:2.0:1787784484.010017:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.010025:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cb6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784484.010063:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750030720:0@lo:501: 00000100:00100000:2.0:1787784484.010100:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784484.010112:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784484.010122:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750030720 00000100:00100000:2.0:1787784484.010125:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750030720 00000100:00100000:2.0:1787784484.010143:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787784484.010148:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750030720:12345-0@lo:501: 00000100:00100000:2.0:1787784484.010234:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750030720:12345-0@lo:501: Request processed in 85us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784484.010241:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787784484.010267:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750030720:0@lo:501: 00000100:00100000:2.0:1787784484.010289:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750030848:0@lo:503: 00000100:00100000:2.0:1787784484.010320:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784484.010331:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784484.010342:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750030848 00000100:00100000:2.0:1787784484.010345:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750030848 00000100:00100000:2.0:1787784484.010362:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787784484.010368:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750030848:12345-0@lo:503: 00000100:00100000:2.0:1787784484.010431:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750030848:12345-0@lo:503: Request processed in 62us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784484.010438:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787784484.010470:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750030848:0@lo:503: 00000100:00100000:1.0:1787784484.010694:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750031360:0@lo:400: 00000100:00100000:1.0:1787784484.010724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784484.010744:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787784484.010750:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750030976:0@lo:400: 00000100:00100000:1.0:1787784484.010792:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784484.010810:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750031488:0@lo:400: 00000100:00100000:1.0:1787784484.010832:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784484.010851:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750031104:0@lo:400: 00000100:00100000:1.0:1787784484.010873:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784484.010889:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784484.010893:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750031232:0@lo:400: 00000100:00100000:1.0:1787784484.010909:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784484.010931:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750031360 00000100:00100000:1.0:1787784484.010934:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750031360 00000100:00100000:1.0:1787784484.010962:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750030976 00000100:00100000:1.0:1787784484.010965:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750030976 00000100:00100000:1.0:1787784484.010973:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750031488 00000100:00100000:1.0:1787784484.010975:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750031488 00000100:00100000:1.0:1787784484.010985:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750031232 00000100:00100000:1.0:1787784484.010986:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750031232 00000100:00100000:1.0:1787784484.010996:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787784484.011002:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750031360:12345-0@lo:400: 00000100:00100000:1.0:1787784484.011047:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750031360:12345-0@lo:400: Request processed in 44us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784484.011054:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787784484.011066:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787784484.011085:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750030976:12345-0@lo:400: 00000100:00100000:1.0:1787784484.011110:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750030976:12345-0@lo:400: Request processed in 39us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784484.011115:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787784484.011125:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787784484.011130:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750031488:12345-0@lo:400: 00000100:00100000:1.0:1787784484.011149:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750031488:12345-0@lo:400: Request processed in 20us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784484.011154:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787784484.011162:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784484.011166:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750031232:12345-0@lo:400: 00000100:00100000:1.0:1787784484.011189:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750031232:12345-0@lo:400: Request processed in 22us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784484.011193:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784484.011213:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750031104 00000100:00100000:1.0:1787784484.011215:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750031104 00000100:00100000:1.0:1787784484.011234:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784484.011239:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750031104:12345-0@lo:400: 00000100:00100000:1.0:1787784484.011265:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750031104:12345-0@lo:400: Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784484.011270:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787784484.011286:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784484.011295:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787784484.011317:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f53c9e00 x1874627750031232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784484.011327:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750031232:0@lo:400: 00000100:00100000:1.0:1787784484.011335:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750031104:0@lo:400: 00010000:00080000:1.0:1787784484.011356:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f53c8780 x1874627750030976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784484.011363:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750030976:0@lo:400: 00010000:00080000:1.0:1787784484.011370:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f53c8b40 x1874627750031488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784484.011377:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750031488:0@lo:400: 00010000:00080000:1.0:1787784484.011384:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f53cbc00 x1874627750031360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784484.011392:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750031360:0@lo:400: 00000100:00100000:0.0:1787784484.012149:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750030336 00000100:00100000:0.0:1787784484.012157:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750030336 00000100:00100000:0.0:1787784484.012194:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784484.012201:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1874627750030336:12345-0@lo:8: 00010000:00080000:0.0:1787784484.012228:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1787784484.012254:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9cb72 00002000:00100000:0.0:1787784484.012293:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8950c20db800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787784484.012297:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1787784484.012301:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787784484.012363:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787784484.012598:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787784484.012623:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8950c20da800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784484.013510:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1874627750030336:12345-0@lo:8: Request processed in 1304us (4749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784484.013520:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787784484.013599:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f5e00 x1874627750030336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784484.013613:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787784484.013622:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787784484.013630:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787784484.013636:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787784484.013639:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f67db000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787784484.013694:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787784484.013700:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750030336:0@lo:8: 00000004:00080000:0.0:1787784484.013825:0:8910:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787784484.013978:0:8910:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 224263208681ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787784484.013986:0:8910:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787784484.015058:0:8912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8912:1874627750031616:0@lo:502: 00000100:00100000:2.0:1787784484.015798:0:8912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784484.015836:0:8912:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784484.016171:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750031616 00000100:00100000:3.0:1787784484.016180:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750031616 00000100:00100000:3.0:1787784484.016229:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787784484.016238:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:8912:x1874627750031616:12345-0@lo:502: 00000100:00100000:3.0:1787784484.016369:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:8912:x1874627750031616:12345-0@lo:502: Request processed in 131us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784484.016384:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787784484.016516:0:8911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1874627750031744:0@lo:700: 00000100:00100000:1.0:1787784484.016555:0:8911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784484.016576:0:8911:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784484.016983:0:8912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8912:1874627750031616:0@lo:502: 00000100:00100000:2.0:1787784484.017035:0:8912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8912:1874627750031872:0@lo:502: 00000100:00100000:2.0:1787784484.017083:0:8912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784484.017106:0:8912:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784484.017189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750031872 00000100:00100000:1.0:1787784484.017194:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750031872 00000100:00100000:1.0:1787784484.017233:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787784484.017242:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+18:8912:x1874627750031872:12345-0@lo:502: 00000100:00100000:1.0:1787784484.017330:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+18:8912:x1874627750031872:12345-0@lo:502: Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784484.017337:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787784484.017444:0:8912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8912:1874627750031872:0@lo:502: 00000040:00080000:2.0:1787784484.017463:0:8912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787784484.017614:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787784484.017635:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787784484.017645:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784484.017656:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784484.017664:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787784484.017667:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951d08ed800 from 5 10000000:01000000:3.0:1787784484.017670:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787784484.017694:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784484.017702:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784484.017712:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784484.017723:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750032000:0@lo:101: 00000100:00100000:3.0:1787784484.017762:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784484.017805:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d13a5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784484.017922:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750032000 00000100:00100000:2.0:1787784484.017927:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750032000 00000100:00100000:2.0:1787784484.017949:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787784484.017956:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750032000:12345-0@lo:101: 00010000:00010000:2.0:1787784484.017964:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784484.017976:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5b800/0x88ace7295d9cb80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cb79 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.017997:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5b800/0x88ace7295d9cb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cb79 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.018006:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5b800/0x88ace7295d9cb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cb79 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.018026:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5b800, rc 0) 00000100:00100000:2.0:1787784484.018066:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750032000:12345-0@lo:101: Request processed in 110us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784484.018081:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787784484.018146:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750032000:0@lo:101: 00010000:00010000:3.0:1787784484.018158:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784484.018167:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cb80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784484.018210:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750032128:0@lo:256: 00000100:00100000:3.0:1787784484.018238:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784484.018268:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d13a5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784484.018311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750032128 00000100:00100000:2.0:1787784484.018316:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750032128 00000100:00100000:2.0:1787784484.018346:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787784484.018353:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750032128:12345-0@lo:256: 20000000:01000000:2.0:1787784484.018365:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787784484.018380:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787784484.018383:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787784484.018453:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750032128:12345-0@lo:256: Request processed in 100us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784484.018460:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787784484.018487:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750032128:0@lo:256: 10000000:01000000:2.0:1787784484.018525:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787784484.018531:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.018538:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784484.018545:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787784484.018547:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787784484.018549:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787784484.018562:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.018578:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.018586:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784484.018596:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750032256:0@lo:101: 00000100:00100000:2.0:1787784484.018620:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784484.018633:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784484.018644:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750032256 00000100:00100000:2.0:1787784484.018647:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750032256 00000100:00100000:2.0:1787784484.018661:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787784484.018667:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750032256:12345-0@lo:101: 00010000:00010000:2.0:1787784484.018673:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784484.018681:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5bc00/0x88ace7295d9cb8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cb87 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.018693:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5bc00/0x88ace7295d9cb8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cb87 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.018700:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5bc00/0x88ace7295d9cb8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cb87 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.018707:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5bc00, rc 0) 00000100:00100000:2.0:1787784484.018903:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750032256:12345-0@lo:101: Request processed in 235us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784484.018909:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787784484.018938:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750032256:0@lo:101: 00010000:00010000:2.0:1787784484.018954:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb8e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.018962:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cb8e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784484.019007:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750032384:0@lo:501: 00000100:00100000:2.0:1787784484.019031:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784484.019313:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750031744 00000100:00100000:0.0:1787784484.019318:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750031744 00000100:00100000:0.0:1787784484.019357:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784484.019364:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8911:x1874627750031744:12345-0@lo:700: 00000100:00100000:0.0:1787784484.019392:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2363840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8444:1874627750032512:0@lo:700: 00000100:00100000:0.0:1787784484.019422:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784484.019441:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9780 going to sleep for 11 seconds 00000100:00080000:0.0:1787784484.019453:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784484.019510:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784484.019844:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750032512 00000100:00100000:2.0:1787784484.019848:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750032512 00000100:00100000:2.0:1787784484.019875:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784484.019879:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2361680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8444:x1874627750032512:12345-0@lo:700: 00000004:00080000:0.0:1787784484.027438:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787784484.027640:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750032384 00000100:00100000:3.0:1787784484.027650:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750032384 40000000:02000000:1.0:1787784484.029095:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1787784484.033392:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787784484.033407:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750032384:12345-0@lo:501: 00000100:00100000:3.0:1787784484.033622:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750032384:12345-0@lo:501: Request processed in 217us (14589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784484.033630:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787784484.034859:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750032384:0@lo:501: 00000100:00100000:2.0:1787784484.034943:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750032640:0@lo:503: 00000100:00100000:2.0:1787784484.035225:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784484.035266:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784484.035329:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750032640 00000100:00100000:0.0:1787784484.035337:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750032640 00000100:00100000:0.0:1787784484.035380:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787784484.035389:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750032640:12345-0@lo:503: 00000100:00100000:0.0:1787784484.035524:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750032640:12345-0@lo:503: Request processed in 135us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784484.035532:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787784484.035850:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750032640:0@lo:503: 00000100:00100000:2.0:1787784484.037041:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8913:1874627750032768:0@lo:502: 00000100:00100000:2.0:1787784484.037112:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784484.037150:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787784484.037255:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750032768 00000100:00100000:0.0:1787784484.037261:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750032768 00000100:00100000:0.0:1787784484.037310:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787784484.037320:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+20:8913:x1874627750032768:12345-0@lo:502: 00000100:00100000:0.0:1787784484.037441:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+20:8913:x1874627750032768:12345-0@lo:502: Request processed in 122us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784484.037450:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787784484.037605:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8913:1874627750032768:0@lo:502: 00000020:01000000:3.0:1787784484.037631:0:8913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787784484.037639:0:8913:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787784484.037647:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784484.037649:0:8913:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787784484.037654:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787784484.037658:0:8913:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:3.0:1787784484.037677:0:8913:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787784484.037680:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784484.037695:0:8913:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8951effecd28) 00000020:00000080:3.0:1787784484.037720:0:8913:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1787784484.037735:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787784484.037851:0:8913:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787784484.037858:0:8913:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787784484.037865:0:8913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9cb9c 00010000:00080000:3.0:1787784484.037907:0:8913:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951f67dd000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1787784484.038157:0:8913:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:1.0:1787784484.039562:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2361680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8444:x1874627750032512:12345-0@lo:700: Request processed in 19674us (20132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784484.039578:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787784484.040274:0:8444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c2363840 x1874627750032512/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787784500 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784484.040289:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2363840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8444:1874627750032512:0@lo:700: 40000000:02000000:0.0:1787784484.040301:0:8444:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00100000:3.0:1787784484.052207:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787784484.052404:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8911:x1874627750031744:12345-0@lo:700: Request processed in 33034us (35841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784484.052417:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787784484.052544:0:8911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951e1ffda40 x1874627750031744/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787784500 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784484.052559:0:8911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1874627750031744:0@lo:700: 00000040:01000000:3.0:1787784484.054638:0:8913:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787784484.054666:0:8913:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787784484.054924:0:8913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784484.055139:0:8913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784484.055229:0:8913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787784484.055331:0:8913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787784484.057392:0:8914:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784484.057400:0:8914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787784484.058270:0:8913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787784484.058287:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787784484.058335:0:8913:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787784484.058359:0:8913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9cba3 00000100:00080000:2.0:1787784484.058370:0:8913:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784484.058377:0:8913:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8951f67dd000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784484.058419:0:8913:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c19f70c0 x1874627750032896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784484.058650:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750032896:0@lo:8: 00000100:00100000:3.0:1787784484.058722:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787784484.058913:0:8913:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787784484.058971:0:8913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784484.058976:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784484.058978:0:8913:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787784484.058981:0:8913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784484.058986:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784484.058987:0:8913:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784484.058990:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784484.058992:0:8913:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787784484.059015:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8913:1874627750033024:0@lo:502: 00000100:00100000:2.0:1787784484.059058:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784484.059093:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787784484.059265:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750032896 00000100:00100000:0.0:1787784484.059272:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750032896 00000100:00100000:0.0:1787784484.059307:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784484.059315:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5316940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750032896:12345-0@lo:8: 00010000:00080000:0.0:1787784484.059341:0:8438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1787784484.059364:0:8438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9cbaa 00002000:00100000:0.0:1787784484.059376:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8950c20dc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787784484.059380:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787784484.059383:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787784484.059466:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787784484.059488:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8950c20dd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784484.059739:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5316940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1874627750032896:12345-0@lo:8: Request processed in 422us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784484.059746:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787784484.060247:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f70c0 x1874627750032896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784484.060256:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787784484.060263:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787784484.060271:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787784484.060276:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787784484.060278:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f67dd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787784484.063828:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750033024 00000100:00100000:2.0:1787784484.063842:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750033024 00000100:00100000:2.0:1787784484.063900:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787784484.063910:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:8913:x1874627750033024:12345-0@lo:502: 00000100:00100000:2.0:1787784484.064101:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:8913:x1874627750033024:12345-0@lo:502: Request processed in 192us (5042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784484.064109:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787784484.064174:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:8913:1874627750033024:0@lo:502: 00000020:01000000:2.0:1787784484.064206:0:8913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784484.064217:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784484.064219:0:8913:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787784484.064223:0:8913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:3.0:1787784484.065628:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787784484.065640:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750032896:0@lo:8: 00000020:01000000:3.0:1787784484.065670:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787784484.065695:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787784484.065704:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb8e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784484.065713:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cb8e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784484.065722:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787784484.065738:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8951cfef0000 from 1 10000000:01000000:3.0:1787784484.065740:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787784484.065787:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784484.065793:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784484.065800:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784484.065817:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750033152:0@lo:101: 00000100:00100000:3.0:1787784484.065866:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784484.065894:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e33540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784484.066143:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750033152 00000100:00100000:2.0:1787784484.066151:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750033152 00000100:00100000:2.0:1787784484.066197:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787784484.066205:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750033152:12345-0@lo:101: 00010000:00010000:2.0:1787784484.066217:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784484.066227:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5a800/0x88ace7295d9cbb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cbb1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.066245:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5a800/0x88ace7295d9cbb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cbb1 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.066252:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5a800/0x88ace7295d9cbb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cbb1 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784484.066257:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a800, rc 0) 00000100:00100000:2.0:1787784484.066287:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750033152:12345-0@lo:101: Request processed in 83us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784484.066293:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000004:00080000:2.0:1787784484.066893:0:8911:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787784484.066912:0:8911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1874627750033408:0@lo:7: 00000100:00100000:2.0:1787784484.066951:0:8911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784484.066987:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750033408 00000100:00100000:2.0:1787784484.066992:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750033408 00000100:00100000:2.0:1787784484.067021:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784484.067028:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8911:x1874627750033408:12345-0@lo:7: 00000100:00100000:1.0:1787784484.067598:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750033152:0@lo:101: 00010000:00010000:1.0:1787784484.067614:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cbb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784484.067623:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cbb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784484.067667:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750033536:0@lo:501: 00000100:00100000:1.0:1787784484.067692:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784484.067713:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24da180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784484.067723:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750033280:0@lo:13: 00000100:00100000:1.0:1787784484.067752:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784484.067813:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750033536 00000100:00100000:1.0:1787784484.067816:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750033536 00000100:00100000:1.0:1787784484.067838:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787784484.067842:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750033536:12345-0@lo:501: 00000100:00100000:1.0:1787784484.067898:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750033536:12345-0@lo:501: Request processed in 54us (204us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787784484.067905:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787784484.067936:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750033536:0@lo:501: 10000000:01000000:1.0:1787784484.067960:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787784484.067967:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cbb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784484.067983:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cbb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784484.068126:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750033280 00000100:00100000:3.0:1787784484.068130:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750033280 00000100:00100000:3.0:1787784484.068164:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784484.068171:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1874627750033280:12345-0@lo:13: 00002000:00000024:3.0:1787784484.068189:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:3.0:1787784484.068233:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1874627750033280:12345-0@lo:13: Request processed in 62us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784484.068240:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787784484.068266:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f4f00 x1874627750033280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784484.068281:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750033280:0@lo:13: 00000100:00100000:3.0:1787784484.069214:0:8911:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95da80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784484.069939:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784484.069952:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750033664:0@lo:13: 00000100:00100000:3.0:1787784484.069999:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784484.070037:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750033664 00000100:00100000:3.0:1787784484.070042:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750033664 00000100:00100000:3.0:1787784484.070095:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784484.070104:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750033664:12345-0@lo:13: 00002000:00000024:3.0:1787784484.070121:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:3.0:1787784484.070158:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750033664:12345-0@lo:13: Request processed in 55us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784484.070165:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787784484.070182:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787784484.070206:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f53170c0 x1874627750033664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784484.070221:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750033664:0@lo:13: 00000004:00080000:3.0:1787784484.070237:0:8915:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787784484.070254:0:8915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53170c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1874627750033792:0@lo:7: 00000100:00100000:3.0:1787784484.070278:0:8915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784484.070304:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784484.070310:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787784484.070331:0:8915:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e33a80 going to sleep for 11 seconds 00000004:00080000:0.0:1787784484.071140:0:8914:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787784484.071206:0:8914:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 224320436815ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787784484.071212:0:8914:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787784484.075932:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750033792 00000100:00100000:1.0:1787784484.075948:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750033792 00002000:00080000:2.0:1787784484.078083:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787784484.078097:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787784484.078201:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8911:x1874627750033408:12345-0@lo:7: Request processed in 11168us (11245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784484.078211:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784484.078245:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784484.078255:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8915:x1874627750033792:12345-0@lo:7: 00010000:00080000:3.0:1787784484.081939:0:8911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f61c0 x1874627750033408/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787784500 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784484.081959:0:8911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1874627750033408:0@lo:7: 00000004:00080000:3.0:1787784484.081974:0:8911:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787784484.082015:0:8911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1874627750033920:0@lo:5: 00000100:00100000:3.0:1787784484.082082:0:8911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784484.082125:0:8911:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e33cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784484.082180:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750033920 00000100:00100000:1.0:1787784484.082187:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750033920 00000100:00100000:1.0:1787784484.082850:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784484.082862:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5316580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8911:x1874627750033920:12345-0@lo:5: 00002000:00080000:1.0:1787784484.082888:0:8438:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787784484.082942:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5316580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8911:x1874627750033920:12345-0@lo:5: Request processed in 83us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784484.082949:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00080000:2.0:1787784484.084000:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787784484.084006:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787784484.084064:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8915:x1874627750033792:12345-0@lo:7: Request processed in 5809us (13782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784484.084083:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787784484.084129:0:8915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f53170c0 x1874627750033792/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787784500 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784484.084142:0:8915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53170c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1874627750033792:0@lo:7: 00000004:00080000:2.0:1787784484.084153:0:8915:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787784484.084180:0:8915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1874627750034048:0@lo:5: 00000100:00100000:2.0:1787784484.084206:0:8915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787784484.084275:0:8911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f53143c0 x1874627750033920/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784500 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784484.084296:0:8911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1874627750033920:0@lo:5: 00000004:00080000:3.0:1787784484.084305:0:8911:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787784484.084326:0:8911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1874627750034176:0@lo:5: 00000100:00100000:2.0:1787784484.084637:0:8915:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951cfeb6600 going to sleep for 11 seconds 00000100:00100000:3.0:1787784484.084680:0:8911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784484.084711:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750034048 00000100:00100000:0.0:1787784484.084718:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750034048 00000100:00100000:0.0:1787784484.084761:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784484.084784:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8915:x1874627750034048:12345-0@lo:5: 00002000:00080000:0.0:1787784484.084807:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787784484.084811:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000004:00080000:0.0:1787784484.086215:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787784484.091216:0:8911:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e33cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784484.091286:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750034176 00000100:00100000:1.0:1787784484.091298:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750034176 00000100:00100000:1.0:1787784484.091361:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784484.091372:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5316d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8911:x1874627750034176:12345-0@lo:5: 00002000:00080000:1.0:1787784484.091434:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787784484.093151:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5316d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8911:x1874627750034176:12345-0@lo:5: Request processed in 1775us (8463us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787784484.093163:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00080000:0.0:1787784484.093760:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787784484.093808:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1787784484.093940:0:8911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f53143c0 x1874627750034176/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784500 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784484.093960:0:8911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8911:1874627750034176:0@lo:5: 00000004:00080000:3.0:1787784484.093976:0:8911:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1787784484.094018:0:8911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8911:1874627750034304:0@lo:900: 00000100:00100000:3.0:1787784484.094066:0:8911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784484.094112:0:8911:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e33cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784484.094160:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750034304 00000100:00100000:0.0:1787784484.094165:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750034304 00000100:00100000:0.0:1787784484.094204:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784484.094213:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8911:x1874627750034304:12345-0@lo:900: 00000100:00100000:0.0:1787784484.094266:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8911:x1874627750034304:12345-0@lo:900: Request processed in 54us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784484.094273:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787784484.094330:0:8911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f5315a40 x1874627750034304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787784500 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784484.094340:0:8911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8911:1874627750034304:0@lo:900: 00000100:00100000:1.0:1787784484.094488:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8915:x1874627750034048:12345-0@lo:5: Request processed in 9719us (10280us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787784484.094495:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787784484.096242:0:8915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f61c0 x1874627750034048/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784500 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784484.096256:0:8915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787784484.096262:0:8915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1874627750034048:0@lo:5: 00000004:00080000:3.0:1787784484.096278:0:8915:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787784484.096327:0:8915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1874627750034432:0@lo:700: 00000100:00100000:3.0:1787784484.096384:0:8915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784484.096485:0:8915:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e33cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784484.096637:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750034432 00000100:00100000:1.0:1787784484.096644:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750034432 00000100:00100000:1.0:1787784484.096735:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784484.096745:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8915:x1874627750034432:12345-0@lo:700: 00000001:00080000:0.0:1787784484.106764:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1787784484.107422:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8915:x1874627750034432:12345-0@lo:700: Request processed in 10672us (11031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784484.107435:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787784484.107832:0:8915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f5315a40 x1874627750034432/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787784500 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784484.107849:0:8915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1874627750034432:0@lo:700: 00000004:02000040:3.0:1787784484.112241:0:8915:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1787784484.117153:0:8915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f70c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1874627750034560:0@lo:5: 00000100:00100000:2.0:1787784484.117221:0:8915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784484.117334:0:8915:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951cfeb6600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784484.117563:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750034560 00000100:00100000:1.0:1787784484.117572:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750034560 00000100:00100000:1.0:1787784484.117668:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784484.117679:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8915:x1874627750034560:12345-0@lo:5: 00002000:00080000:2.0:1787784484.125699:0:8916:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787784484.125737:0:8916:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1787784484.128264:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8915:x1874627750034560:12345-0@lo:5: Request processed in 10580us (11034us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787784484.128277:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787784484.128395:0:8915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f70c0 x1874627750034560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784500 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784484.128413:0:8915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f70c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8915:1874627750034560:0@lo:5: 00000004:00080000:0.0:1787784484.128428:0:8915:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1787784484.359607:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787784484.782163:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1787784485.394647:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787784485.744683:0:8967:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787784485.744934:0:8967:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787784486.024216:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784486.024244:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750034688:0@lo:41: 00000100:00100000:1.0:1787784486.024316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784486.024386:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750034688 00000100:00100000:1.0:1787784486.024395:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750034688 00000100:00100000:1.0:1787784486.024441:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787784486.024451:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750034688:12345-0@lo:41: 00000004:00000024:1.0:1787784486.024488:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787784486.024540:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750034688:12345-0@lo:41: Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784486.024547:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787784486.024569:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750034688:0@lo:41: 00010000:00010000:1.0:1787784486.406062:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787784487.002373:0:9015:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787784487.002385:0:9015:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1787784487.429969:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784488.466660:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784489.093909:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750034816:0@lo:13: 00000100:00100000:3.0:1787784489.093996:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784489.094085:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750034816 00000100:00100000:3.0:1787784489.094092:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750034816 00000100:00100000:3.0:1787784489.094159:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784489.094169:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5317c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750034816:12345-0@lo:13: 00002000:00000024:3.0:1787784489.094214:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784489.094256:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5317c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750034816:12345-0@lo:13: Request processed in 89us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784489.094264:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787784489.094513:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787784489.094543:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f5314780 x1874627750034816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784489.094555:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787784489.094573:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750034816:0@lo:13: 00000100:00100000:0.0:1787784489.095155:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2362580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750034944:0@lo:13: 00000100:00100000:0.0:1787784489.095214:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784489.095242:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784489.095247:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750035072:0@lo:41: 00000100:00100000:0.0:1787784489.095269:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784489.095465:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750035072 00000100:00100000:0.0:1787784489.095470:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750035072 00000100:00100000:0.0:1787784489.095508:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784489.095515:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750035072:12345-0@lo:41: 00000004:00000024:0.0:1787784489.095542:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787784489.095577:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750035072:12345-0@lo:41: Request processed in 62us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784489.095592:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784489.095628:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750035072:0@lo:41: 00000100:00100000:0.0:1787784489.095650:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750034944 00000100:00100000:0.0:1787784489.095654:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750034944 00000100:00100000:0.0:1787784489.095686:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784489.095693:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750034944:12345-0@lo:13: 00002000:00000024:0.0:1787784489.095705:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784489.095739:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750034944:12345-0@lo:13: Request processed in 47us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784489.095745:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787784489.095763:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787784489.095808:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c2362580 x1874627750034944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784489.095818:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1787784489.095831:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2362580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750034944:0@lo:13: 00000100:00100000:3.0:1787784489.096522:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750035328:0@lo:400: 00000100:00100000:3.0:1787784489.096555:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784489.096576:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750035840:0@lo:400: 00000100:00100000:3.0:1787784489.096606:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784489.096622:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787784489.096627:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750035200:0@lo:400: 00000100:00100000:3.0:1787784489.096652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784489.096683:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750035712:0@lo:400: 00000100:00100000:3.0:1787784489.096704:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784489.096731:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750035328 00000100:00100000:3.0:1787784489.096735:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750035328 00000100:00100000:3.0:1787784489.096790:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750035840 00000100:00100000:3.0:1787784489.096793:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750035840 00000100:00100000:3.0:1787784489.096814:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750035712 00000100:00100000:3.0:1787784489.096816:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750035712 00000100:00100000:3.0:1787784489.096836:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787784489.096842:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750035328:12345-0@lo:400: 00000100:00100000:3.0:1787784489.096884:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750035328:12345-0@lo:400: Request processed in 42us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784489.096891:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787784489.096906:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784489.096912:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750035840:12345-0@lo:400: 00000100:00100000:3.0:1787784489.096937:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750035840:12345-0@lo:400: Request processed in 26us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784489.096943:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784489.096954:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787784489.096960:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750035712:12345-0@lo:400: 00000100:00100000:3.0:1787784489.097072:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750035712:12345-0@lo:400: Request processed in 112us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784489.097079:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787784489.097181:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f5291a40 x1874627750035712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784489.097194:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750035712:0@lo:400: 00000100:00100000:0.0:1787784489.097326:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750035584:0@lo:400: 00000100:00100000:0.0:1787784489.097360:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784489.097383:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784489.097389:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750035456:0@lo:400: 00000100:00100000:0.0:1787784489.097409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787784489.097434:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784489.097437:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784489.097447:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750035456 00000100:00100000:0.0:1787784489.097451:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750035456 00000100:00100000:0.0:1787784489.097494:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787784489.097501:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750035456:12345-0@lo:400: 00000100:00100000:0.0:1787784489.097542:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750035456:12345-0@lo:400: Request processed in 41us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784489.097549:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787784489.097578:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750035456:0@lo:400: 00000100:00100000:0.0:1787784489.097600:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750035584 00000100:00100000:0.0:1787784489.097603:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750035584 00000100:00100000:0.0:1787784489.097623:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787784489.097628:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2362580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750035584:12345-0@lo:400: 00000100:00100000:0.0:1787784489.097660:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2362580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750035584:12345-0@lo:400: Request processed in 32us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784489.097667:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787784489.097692:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f52912c0 x1874627750035584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784489.097702:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750035584:0@lo:400: 00000100:00100000:0.0:1787784489.097740:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750035200 00000100:00100000:0.0:1787784489.097744:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750035200 00000100:00100000:0.0:1787784489.097793:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787784489.097801:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:3647:x1874627750035200:12345-0@lo:400: 00010000:00080000:3.0:1787784489.098356:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f53143c0 x1874627750035328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784489.098369:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750035328:0@lo:400: 00000100:00100000:0.0:1787784489.099399:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:3647:x1874627750035200:12345-0@lo:400: Request processed in 1592us (2739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784489.099413:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:3.0:1787784489.103494:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f5293480 x1874627750035840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784489.103513:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750035840:0@lo:400: 00000100:00100000:3.0:1787784489.103553:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750035200:0@lo:400: 00010000:00010000:3.0:1787784489.478078:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784490.514128:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784491.150307:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750035968:0@lo:41: 00000100:00100000:2.0:1787784491.150391:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784491.150466:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750035968 00000100:00100000:1.0:1787784491.150475:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750035968 00000100:00100000:1.0:1787784491.150531:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787784491.150541:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750035968:12345-0@lo:41: 00000004:00000024:1.0:1787784491.150577:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787784491.150633:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750035968:12345-0@lo:41: Request processed in 94us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784491.150647:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787784491.150685:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750035968:0@lo:41: 00010000:00010000:3.0:1787784491.526601:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784492.549940:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784493.574108:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784494.214267:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750036096:0@lo:13: 00000100:00100000:2.0:1787784494.214337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784494.214473:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750036096 00000100:00100000:0.0:1787784494.214480:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750036096 00000100:00100000:0.0:1787784494.214526:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784494.214534:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750036096:12345-0@lo:13: 00002000:00000024:0.0:1787784494.214568:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784494.214612:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750036096:12345-0@lo:13: Request processed in 78us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784494.214618:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784494.214652:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2361a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750036224:0@lo:41: 00000100:00100000:0.0:1787784494.214678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787784494.214708:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787784494.214737:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f4b40 x1874627750036096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784494.214755:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750036096:0@lo:13: 00000100:00100000:0.0:1787784494.214802:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750036224 00000100:00100000:0.0:1787784494.214805:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750036224 00000100:00100000:0.0:1787784494.214829:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784494.214835:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750036224:12345-0@lo:41: 00000004:00000024:0.0:1787784494.214868:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787784494.214899:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750036224:12345-0@lo:41: Request processed in 64us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784494.214905:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784494.214930:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2361a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750036224:0@lo:41: 00000100:00100000:2.0:1787784494.219995:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750036480:0@lo:400: 00000100:00100000:2.0:1787784494.220066:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784494.220111:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750036992:0@lo:400: 00000100:00100000:2.0:1787784494.220136:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784494.220162:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787784494.220167:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750036608:0@lo:400: 00000100:00100000:2.0:1787784494.220190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784494.220205:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750037120:0@lo:400: 00000100:00100000:2.0:1787784494.220223:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784494.220249:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750036480 00000100:00100000:2.0:1787784494.220255:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750036480 00000100:00100000:2.0:1787784494.220296:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787784494.220305:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:3644:x1874627750036480:12345-0@lo:400: 00000100:00100000:2.0:1787784494.220350:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:3644:x1874627750036480:12345-0@lo:400: Request processed in 45us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784494.220357:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787784494.220390:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750036992 00000100:00100000:2.0:1787784494.220394:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750036992 00000100:00100000:2.0:1787784494.220427:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750036608 00000100:00100000:2.0:1787784494.220430:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750036608 00000100:00100000:2.0:1787784494.220441:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750037120 00000100:00100000:2.0:1787784494.220450:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750037120 00000100:00100000:2.0:1787784494.220472:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787784494.220478:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750036992:12345-0@lo:400: 00000100:00100000:2.0:1787784494.220511:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750036992:12345-0@lo:400: Request processed in 33us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784494.220518:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787784494.220529:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787784494.220534:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750036608:12345-0@lo:400: 00000100:00100000:2.0:1787784494.220557:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750036608:12345-0@lo:400: Request processed in 23us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784494.220563:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787784494.220572:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787784494.220579:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750037120:12345-0@lo:400: 00000100:00100000:2.0:1787784494.220606:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750037120:12345-0@lo:400: Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784494.220612:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787784494.221025:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9d73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750036352:0@lo:13: 00000100:00100000:0.0:1787784494.221066:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784494.221087:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750036864:0@lo:400: 00000100:00100000:0.0:1787784494.221108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784494.221128:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787784494.221134:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750036736:0@lo:400: 00000100:00100000:0.0:1787784494.221169:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784494.221186:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750037248:0@lo:400: 00000100:00100000:0.0:1787784494.221205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784494.221239:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750036864 00000100:00100000:0.0:1787784494.221243:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750036864 00000100:00100000:0.0:1787784494.221290:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787784494.221296:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2362940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750036864:12345-0@lo:400: 00000100:00100000:0.0:1787784494.221330:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2362940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750036864:12345-0@lo:400: Request processed in 34us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784494.221337:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787784494.221358:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787784494.221363:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784494.221391:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750036352 00000100:00100000:0.0:1787784494.221395:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750036352 00000100:00100000:0.0:1787784494.221420:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784494.221426:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2361a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750036352:12345-0@lo:13: 00002000:00000024:0.0:1787784494.221441:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784494.221468:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2361a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750036352:12345-0@lo:13: Request processed in 43us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784494.221475:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784494.221492:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750036736 00000100:00100000:0.0:1787784494.221495:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750036736 00000100:00100000:0.0:1787784494.221515:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787784494.221520:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750036736:12345-0@lo:400: 00000100:00100000:0.0:1787784494.221550:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750036736:12345-0@lo:400: Request processed in 29us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784494.221556:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787784494.221598:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750036736:0@lo:400: 00010000:00080000:0.0:1787784494.221613:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951d9d73840 x1874627750036352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784494.221630:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9d73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750036352:0@lo:13: 00000100:00100000:1.0:1787784494.222246:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750037248 00000100:00100000:1.0:1787784494.222253:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750037248 00000100:00100000:1.0:1787784494.222293:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784494.222302:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750037248:12345-0@lo:400: 00010000:00080000:2.0:1787784494.222755:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f5e00 x1874627750036608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784494.222779:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750036608:0@lo:400: 00010000:00080000:2.0:1787784494.222795:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f4b40 x1874627750037120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784494.222804:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750037120:0@lo:400: 00000100:00100000:2.0:1787784494.222813:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750036480:0@lo:400: 00010000:00080000:2.0:1787784494.222822:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f61c0 x1874627750036992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784494.222842:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750036992:0@lo:400: 00010000:00080000:0.0:1787784494.223008:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c19f70c0 x1874627750036864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784494.223018:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750036864:0@lo:400: 00000100:00100000:1.0:1787784494.223040:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750037248:12345-0@lo:400: Request processed in 738us (1831us total) trans 0 rc 0/0 00010000:00080000:0.0:1787784494.223048:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951e1ffda40 x1874627750037248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784494.223051:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784494.223062:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750037248:0@lo:400: 00000100:00080000:0.0:1787784494.223082:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787784494.602271:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784495.622874:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784496.266106:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784496.266136:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750037376:0@lo:41: 00000100:00100000:3.0:1787784496.266259:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784496.266909:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750037376 00000100:00100000:1.0:1787784496.266917:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750037376 00000100:00100000:1.0:1787784496.266978:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787784496.266988:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750037376:12345-0@lo:41: 00000004:00000024:1.0:1787784496.267027:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787784496.267083:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750037376:12345-0@lo:41: Request processed in 97us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784496.267090:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787784496.267996:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750037376:0@lo:41: 00010000:00010000:1.0:1787784496.645908:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787784497.508253:0:9514:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787784497.508257:0:9514:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787784497.508259:0:9514:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787784497.508394:0:9514:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8951f53b5800 00000020:01000004:3.0:1787784497.508408:0:9514:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787784497.508423:0:9514:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787784497.508446:0:9514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8950c25b19b8) 00000020:00000080:3.0:1787784497.508463:0:9514:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787784497.548152:0:9514:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787784497.548213:0:9514:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1787784497.577990:0:9514:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787784497.578253:0:9514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787784497.578270:0:9514:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787784497.578284:0:9514:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x88ace7295d9cbc6 00000020:01000004:2.0:1787784497.578292:0:9514:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787784497.578317:0:9514:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787784497.578321:0:9514:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787784497.578328:0:9514:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787784497.578359:0:9514:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787784497.578364:0:9514:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787784497.605480:0:9514:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787784497.605526:0:9514:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.141@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787784497.605530:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787784497.605532:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787784497.605533:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784497.605535:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784497.605536:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784497.605537:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784497.605539:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784497.605540:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787784497.605542:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787784497.605543:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784497.605545:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784497.605549:0:9514:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787784497.605551:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787784497.605552:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787784497.605553:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784497.605559:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784497.605560:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784497.605561:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784497.605561:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784497.605562:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787784497.605563:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787784497.605564:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784497.605564:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784497.605591:0:9514:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787784497.605691:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750037504:0@lo:253: 00000100:00100000:0.0:1787784497.605995:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784497.606077:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f47c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784497.606118:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750037504 00000100:00100000:1.0:1787784497.606126:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750037504 00000100:00100000:1.0:1787784497.606202:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787784497.606211:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:9514:x1874627750037504:12345-0@lo:253: 20000000:01000000:1.0:1787784497.606241:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787784497.606245:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787784497.606250:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787784497.606254:0:6516:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787784497.606446:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784497.606574:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1787784497.606587:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787784497.606682:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1787784497.606691:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787784497.606706:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1787784497.606722:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1787784497.606984:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1787784497.607000:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:1.0:1787784497.607002:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:1.0:1787784497.607015:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1787784497.607021:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787784497.607033:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1787784497.607038:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:1.0:1787784497.607051:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1787784497.607057:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787784497.607069:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1787784497.607083:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1787784497.607166:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1787784497.607178:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:1.0:1787784497.607180:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:1.0:1787784497.607194:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1787784497.607200:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787784497.607213:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1787784497.607217:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:1.0:1787784497.607228:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1787784497.607234:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787784497.607246:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1787784497.607262:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1787784497.608063:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1787784497.608080:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:1.0:1787784497.608082:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:1.0:1787784497.608107:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1787784497.608115:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787784497.608127:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1787784497.608132:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:1.0:1787784497.608145:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1787784497.608150:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787784497.608161:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1787784497.608176:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1787784497.608190:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787784497.608193:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787784497.608197:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787784497.608244:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787784497.608247:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787784497.609394:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1787784497.609434:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1787784497.609452:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1787784497.609747:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1787784497.609877:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1787784497.609897:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1787784497.609906:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787784497.609908:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787784497.610239:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1787784497.610260:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1787784497.610273:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1787784497.610443:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1787784497.610474:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1787784497.610490:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1787784497.610499:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787784497.610501:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787784497.611080:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1787784497.611112:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1787784497.611123:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787784497.611256:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787784497.611279:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1787784497.611295:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1787784497.611305:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787784497.611308:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787784497.611559:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1787784497.611726:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1787784497.611746:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1787784497.611760:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1787784497.611799:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787784497.611801:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787784497.612271:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1787784497.612292:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1787784497.612307:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1787784497.612463:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1787784497.612482:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1787784497.612498:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:0.0:1787784497.612515:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787784497.612535:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.612555:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c151f200/0x88ace7295d9cac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cabc expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.612575:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c13ff000/0x88ace7295d9caed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cae6 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.612583:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951d1629200/0x88ace7295d9cb2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cb25 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.612591:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff895201c5a200/0x88ace7295d9cb48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cb41 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.612597:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff895201c5a000/0x88ace7295d9cb6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cb64 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.612680:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff895201c5bc00/0x88ace7295d9cb8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cb87 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.612688:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff895201c5a800/0x88ace7295d9cbb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cbb1 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.612696:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.612738:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff895201c5a800/0x88ace7295d9cbb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cbb1 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.612752:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff895201c5a800/0x88ace7295d9cbb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cbb1 expref: 21 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.612998:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2363840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750037632:0@lo:104: 00000100:00100000:0.0:1787784497.613072:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784497.613180:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff895201c5bc00/0x88ace7295d9cb8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cb87 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.613190:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff895201c5bc00/0x88ace7295d9cb8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cb87 expref: 21 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.613198:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750037760:0@lo:104: 00000100:00100000:0.0:1787784497.613221:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784497.613298:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff895201c5a000/0x88ace7295d9cb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cb64 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.613306:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff895201c5a000/0x88ace7295d9cb6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cb64 expref: 21 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.613314:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52912c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750037888:0@lo:104: 00000100:00100000:0.0:1787784497.613339:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784497.613412:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750037632 00000100:00100000:3.0:1787784497.613425:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750037632 00000100:00100000:3.0:1787784497.613459:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750037760 00000100:00100000:3.0:1787784497.613462:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750037760 00000100:00100000:3.0:1787784497.613476:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784497.613484:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:6516:x1874627750037632:12345-0@lo:104: 00010000:00010000:3.0:1787784497.613497:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cbb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.613553:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784497.613559:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:6516:x1874627750037632:12345-0@lo:104: Request processed in 76us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.613566:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784497.613583:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784497.613589:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5291a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:6516:x1874627750037760:12345-0@lo:104: 00010000:00010000:3.0:1787784497.613597:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cb8e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.613639:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787784497.613644:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5291a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:6516:x1874627750037760:12345-0@lo:104: Request processed in 56us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.613650:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1787784497.613759:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784497.613788:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cbb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.613797:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784497.613800:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cbb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.613809:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cbb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784497.613828:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cbb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784497.613834:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784497.613874:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cbb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.613879:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784497.613898:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cbb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.613906:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c151f800/0x88ace7295d9cbb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cbb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.613918:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784497.613921:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cb8e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.613926:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5a400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784497.613928:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cb8e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.613934:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cb8e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784497.613941:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cb8e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784497.613946:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784497.613974:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb8e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.613980:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784497.613985:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb8e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.613991:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cb87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb8e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.613999:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784497.614000:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784497.614002:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784497.614014:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750038016:0@lo:103: 00000100:00100000:2.0:1787784497.614076:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.614098:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784497.614103:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750038144:0@lo:103: 00000100:00100000:2.0:1787784497.614120:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784497.614258:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff895201c5a200/0x88ace7295d9cb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cb41 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.614267:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff895201c5a200/0x88ace7295d9cb48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cb41 expref: 21 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.614276:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750038272:0@lo:104: 00000100:00100000:0.0:1787784497.614295:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784497.614321:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951d1629200/0x88ace7295d9cb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cb25 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.614328:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951d1629200/0x88ace7295d9cb2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cb25 expref: 21 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.614336:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2609a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750038400:0@lo:104: 00000100:00100000:0.0:1787784497.614358:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784497.614371:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c13ff000/0x88ace7295d9caed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cae6 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.614378:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951c13ff000/0x88ace7295d9caed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cae6 expref: 21 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.614386:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750038528:0@lo:104: 00000100:00100000:0.0:1787784497.614406:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784497.614420:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c151f200/0x88ace7295d9cac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cabc expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.614426:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951c151f200/0x88ace7295d9cac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cabc expref: 21 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.614433:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750038656:0@lo:104: 00000100:00100000:0.0:1787784497.614445:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f47600 going to sleep for 11 seconds 00000100:00100000:0.0:1787784497.614462:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2363840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750037632:0@lo:104: 00000100:00100000:0.0:1787784497.614469:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750037760:0@lo:104: 00000100:00100000:3.0:1787784497.614540:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787784497.614556:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784497.614565:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750037888 00000100:00100000:3.0:1787784497.614569:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750037888 00000100:00100000:3.0:1787784497.614587:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750038272 00000100:00100000:3.0:1787784497.614589:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750038272 00000100:00100000:3.0:1787784497.614596:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750038400 00000100:00100000:3.0:1787784497.614597:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750038400 00000100:00100000:3.0:1787784497.614616:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750038528 00000100:00100000:3.0:1787784497.614624:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750038528 00000100:00100000:3.0:1787784497.614637:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750038656 00000100:00100000:3.0:1787784497.614639:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750038656 00000100:00100000:3.0:1787784497.614650:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787784497.614656:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+7:6516:x1874627750037888:12345-0@lo:104: 00010000:00010000:3.0:1787784497.614663:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cb6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.614712:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784497.614717:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+7:6516:x1874627750037888:12345-0@lo:104: Request processed in 62us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.614723:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787784497.614735:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784497.614740:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5315a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+6:6516:x1874627750038272:12345-0@lo:104: 00010000:00010000:3.0:1787784497.614746:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cb48 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.614791:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787784497.614796:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5315a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+6:6516:x1874627750038272:12345-0@lo:104: Request processed in 56us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.614801:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784497.614813:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787784497.614817:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2608780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+5:6516:x1874627750038400:12345-0@lo:104: 00010000:00010000:3.0:1787784497.614824:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cb2c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.614846:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787784497.614850:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2608780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+5:6516:x1874627750038400:12345-0@lo:104: Request processed in 33us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.614861:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787784497.614871:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787784497.614876:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2097450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:6516:x1874627750038528:12345-0@lo:104: 00010000:00010000:3.0:1787784497.614882:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9caed expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.614904:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787784497.614909:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2097450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:6516:x1874627750038528:12345-0@lo:104: Request processed in 33us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.614914:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787784497.614941:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787784497.614946:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d70780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:6516:x1874627750038656:12345-0@lo:104: 00010000:00010000:3.0:1787784497.614965:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cac3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.614987:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787784497.614991:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d70780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:6516:x1874627750038656:12345-0@lo:104: Request processed in 46us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.614996:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787784497.615114:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787784497.615119:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cb6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615126:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5be00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784497.615129:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cb6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615136:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cb6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784497.615142:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cb6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784497.615153:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784497.615181:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615187:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784497.615206:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615213:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff895201c5be00/0x88ace7295d9cb64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615222:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787784497.615225:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cb48 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615231:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784497.615234:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cb48 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615240:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cb48 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784497.615245:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cb48 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784497.615250:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784497.615262:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb48 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615268:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784497.615279:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb48 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615285:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9cb41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb48 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615294:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787784497.615297:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cb2c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615302:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c13ff600 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784497.615304:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cb2c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615310:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cb2c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784497.615315:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cb2c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784497.615320:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784497.615332:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb2c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615336:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784497.615348:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb2c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615353:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c13ff600/0x88ace7295d9cb25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb2c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615361:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784497.615369:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9caed expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615374:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628200 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784497.615377:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9caed expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615383:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9caed expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784497.615389:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9caed expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784497.615394:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784497.615406:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9caed expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615412:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784497.615417:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9caed expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615422:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9cae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9caed expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615431:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784497.615433:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cac3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615438:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629600 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784497.615441:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cac3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615458:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cac3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784497.615463:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cac3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784497.615467:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784497.615480:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cac3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615485:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784497.615490:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cac3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615495:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1629600/0x88ace7295d9cabc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cac3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615508:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784497.615509:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784497.615511:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784497.615523:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750038784:0@lo:103: 00000100:00100000:2.0:1787784497.615555:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.615575:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750039296:0@lo:103: 00000100:00100000:2.0:1787784497.615595:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.615627:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784497.615633:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750038912:0@lo:103: 00000100:00100000:2.0:1787784497.615652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.615682:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750038016 00000100:00100000:2.0:1787784497.615691:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750038016 00010000:00010000:2.0:1787784497.615714:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff895201c5a800/0x88ace7295d9cbb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cbb1 expref: 22 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784497.615730:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750038144 00000100:00100000:2.0:1787784497.615732:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750038144 00010000:00010000:2.0:1787784497.615741:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff895201c5bc00/0x88ace7295d9cb8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cb87 expref: 23 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784497.615750:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750038784 00000100:00100000:2.0:1787784497.615751:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750038784 00010000:00010000:2.0:1787784497.615793:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff895201c5a000/0x88ace7295d9cb6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cb64 expref: 24 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784497.615807:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750039296 00000100:00100000:2.0:1787784497.615810:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750039296 00010000:00010000:2.0:1787784497.615820:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c151f200/0x88ace7295d9cac3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cabc expref: 25 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784497.615827:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750038912 00000100:00100000:2.0:1787784497.615829:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750038912 00010000:00010000:2.0:1787784497.615835:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff895201c5a200/0x88ace7295d9cb48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cb41 expref: 26 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784497.615846:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784497.615851:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e11e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+26:3644:x1874627750038016:12345-0@lo:103: 00010000:00010000:2.0:1787784497.615861:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784497.615866:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff895201c5a800/0x88ace7295d9cbb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cbb1 expref: 26 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615877:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff895201c5a800/0x88ace7295d9cbb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cbb1 expref: 26 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615902:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5a800/0x88ace7295d9cbb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cbb1 expref: 26 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.615917:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784497.615944:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e11e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+25:3644:x1874627750038016:12345-0@lo:103: Request processed in 92us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.615962:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784497.615975:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787784497.615981:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e112c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750038144:12345-0@lo:103: 00010000:00010000:2.0:1787784497.615988:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784497.615992:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff895201c5bc00/0x88ace7295d9cb8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cb87 expref: 24 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616000:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff895201c5bc00/0x88ace7295d9cb8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cb87 expref: 24 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616010:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5bc00/0x88ace7295d9cb8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cb87 expref: 24 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616018:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784497.616040:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e112c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+23:3644:x1874627750038144:12345-0@lo:103: Request processed in 60us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.616046:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787784497.616057:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787784497.616063:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+22:3646:x1874627750038784:12345-0@lo:103: 00010000:00010000:2.0:1787784497.616070:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784497.616073:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff895201c5a000/0x88ace7295d9cb6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cb64 expref: 22 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616087:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff895201c5a000/0x88ace7295d9cb6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cb64 expref: 22 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616096:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784497.616121:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+22:3646:x1874627750038784:12345-0@lo:103: Request processed in 59us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.616127:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787784497.616139:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787784497.616144:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfebd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+21:3646:x1874627750039296:12345-0@lo:103: 00010000:00010000:2.0:1787784497.616151:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784497.616154:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c151f200/0x88ace7295d9cac3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cabc expref: 21 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616161:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c151f200/0x88ace7295d9cac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cabc expref: 21 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616169:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784497.616187:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfebd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+21:3646:x1874627750039296:12345-0@lo:103: Request processed in 44us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.616193:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787784497.616226:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787784497.616232:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+20:3646:x1874627750038912:12345-0@lo:103: 00010000:00010000:2.0:1787784497.616238:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784497.616242:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff895201c5a200/0x88ace7295d9cb48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cb41 expref: 20 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616249:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff895201c5a200/0x88ace7295d9cb48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cb41 expref: 20 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616265:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784497.616286:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+20:3646:x1874627750038912:12345-0@lo:103: Request processed in 55us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.616291:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787784497.616309:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750039168:0@lo:103: 00000100:00100000:2.0:1787784497.616330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.616385:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784497.616392:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750039040:0@lo:103: 00000100:00100000:2.0:1787784497.616411:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.616442:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750038144:0@lo:103: 00000100:00100000:2.0:1787784497.616449:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750038016:0@lo:103: 00000100:00100000:2.0:1787784497.616475:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750038912:0@lo:103: 00000100:00100000:2.0:1787784497.616483:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750038784:0@lo:103: 00000100:00100000:2.0:1787784497.616490:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750039296:0@lo:103: 00000100:00100000:2.0:1787784497.616506:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750039168 00000100:00100000:2.0:1787784497.616509:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750039168 00010000:00010000:2.0:1787784497.616523:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c13ff000/0x88ace7295d9caed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cae6 expref: 20 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784497.616535:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750039040 00000100:00100000:2.0:1787784497.616538:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750039040 00010000:00010000:2.0:1787784497.616547:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951d1629200/0x88ace7295d9cb2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cb25 expref: 21 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784497.616558:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787784497.616571:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+21:3645:x1874627750039168:12345-0@lo:103: 00010000:00010000:2.0:1787784497.616577:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784497.616583:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c13ff000/0x88ace7295d9caed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cae6 expref: 21 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616590:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c13ff000/0x88ace7295d9caed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cae6 expref: 21 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616598:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784497.616624:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+21:3645:x1874627750039168:12345-0@lo:103: Request processed in 54us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.616630:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787784497.616642:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787784497.616648:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+20:3645:x1874627750039040:12345-0@lo:103: 00010000:00010000:2.0:1787784497.616655:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784497.616658:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951d1629200/0x88ace7295d9cb2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cb25 expref: 20 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616665:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951d1629200/0x88ace7295d9cb2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cb25 expref: 20 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616675:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616683:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616695:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616710:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616717:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616723:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616729:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784497.616733:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616740:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616749:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.616758:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784497.616809:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+20:3645:x1874627750039040:12345-0@lo:103: Request processed in 161us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.616815:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787784497.616839:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750039040:0@lo:103: 00000100:00100000:2.0:1787784497.616846:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750039168:0@lo:103: 00010000:00010000:0.0:1787784497.617047:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5a000/0x88ace7295d9cb6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cb64 expref: 19 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.617060:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52912c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750037888:0@lo:104: 00010000:00010000:0.0:1787784497.617071:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5a200/0x88ace7295d9cb48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cb41 expref: 18 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.617079:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750038272:0@lo:104: 00010000:00010000:0.0:1787784497.617088:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629200/0x88ace7295d9cb2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cb25 expref: 17 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.617107:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2609a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750038400:0@lo:104: 00010000:00010000:0.0:1787784497.617119:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c13ff000/0x88ace7295d9caed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cae6 expref: 16 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.617129:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750038528:0@lo:104: 00010000:00010000:0.0:1787784497.617138:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c151f200/0x88ace7295d9cac3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cabc expref: 15 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.617147:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874627750038656:0@lo:104: 00010000:00010000:0.0:1787784497.617175:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.617184:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.617191:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.617196:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cbcd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787784497.617214:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787784497.619162:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+14:9514:x1874627750037504:12345-0@lo:253: Request processed in 12942us (13386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.619177:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787784497.619280:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750037504:0@lo:253: 10000000:01000000:0.0:1787784497.619294:0:9514:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787784497.619298:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787784497.619299:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787784497.619301:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784497.619302:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787784497.619308:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784497.619309:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784497.619311:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784497.619312:0:9514:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787784497.619314:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784497.619315:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787784497.619333:0:9514:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8951f53b5800 from lustre-OST0001 10000000:01000000:0.0:1787784497.619363:0:9514:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787784497.619366:0:9514:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787784497.619373:0:9514:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8951cfef0000 local copy 10000000:01000000:0.0:1787784497.619378:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787784497.619413:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.619423:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.619431:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.619449:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750039424:0@lo:101: 00000100:00100000:0.0:1787784497.619484:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784497.619523:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f47a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784497.619566:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750039424 00000100:00100000:2.0:1787784497.619572:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750039424 00000100:00100000:2.0:1787784497.619741:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787784497.619750:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+14:9514:x1874627750039424:12345-0@lo:101: 00010000:00010000:2.0:1787784497.619764:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784497.619809:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5ba00/0x88ace7295d9cbdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cbd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.619831:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5ba00/0x88ace7295d9cbdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cbd4 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.619841:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5ba00/0x88ace7295d9cbdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cbd4 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.619849:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5ba00, rc 0) 00000100:00100000:2.0:1787784497.619881:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750039424:12345-0@lo:101: Request processed in 133us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.619888:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787784497.619968:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750039424:0@lo:101: 00010000:00010000:0.0:1787784497.619982:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x88ace7295d9cbdb expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.619990:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x88ace7295d9cbdb expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.620074:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750039552:0@lo:501: 00000100:00100000:0.0:1787784497.620097:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784497.620182:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784497.620498:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f47a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784497.620527:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750039552 00000100:00100000:3.0:1787784497.620532:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750039552 00000100:00100000:3.0:1787784497.620578:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787784497.620586:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfeea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750039552:12345-0@lo:501: 00000100:00100000:3.0:1787784497.620865:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfeea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750039552:12345-0@lo:501: Request processed in 280us (766us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784497.620873:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787784497.621188:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750039552:0@lo:501: 10000000:01000000:0.0:1787784497.621205:0:9514:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787784497.621229:0:9514:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787784497.621236:0:9514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x88ace7295d9cbdb expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.621246:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x88ace7295d9cbdb expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.621253:0:9514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x88ace7295d9cbdb expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.621275:0:9514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787784497.621300:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8951f53b5800 10000000:01000000:0.0:1787784497.621306:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787784497.621311:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787784497.621313:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787784497.621317:0:9514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787784497.621320:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787784497.621341:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.621348:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.621356:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.621370:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750039680:0@lo:101: 00000100:00100000:0.0:1787784497.621409:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784497.621525:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784497.621532:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x88ace7295d9cbdb expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.621541:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784497.621545:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x88ace7295d9cbdb expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.621554:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x88ace7295d9cbdb expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784497.621561:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x88ace7295d9cbdb expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784497.621566:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787784497.621589:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x88ace7295d9cbdb expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.621596:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784497.621625:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x88ace7295d9cbdb expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.621633:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9cbd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x88ace7295d9cbdb expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.621643:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784497.621645:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784497.621646:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784497.621750:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f47840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784497.621863:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750039808:0@lo:103: 00000100:00100000:3.0:1787784497.621895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.622013:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750039808 00000100:00100000:2.0:1787784497.622019:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750039808 00000100:00100000:2.0:1787784497.622059:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784497.622067:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+15:3647:x1874627750039808:12345-0@lo:103: 00010000:00010000:2.0:1787784497.622078:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784497.622090:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5ba00/0x88ace7295d9cbdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9cbd4 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.622104:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784497.622137:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+14:3647:x1874627750039808:12345-0@lo:103: Request processed in 71us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.622153:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784497.622179:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750039808:0@lo:103: 00000100:00100000:1.0:1787784497.622267:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750039680 00000100:00100000:1.0:1787784497.622271:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750039680 00000100:00100000:1.0:1787784497.622299:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787784497.622305:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfeeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+14:9514:x1874627750039680:12345-0@lo:101: 00010000:00010000:1.0:1787784497.622315:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784497.622331:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34800/0x88ace7295d9cbe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cbe2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784497.622349:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34800/0x88ace7295d9cbe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cbe2 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784497.622359:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34800/0x88ace7295d9cbe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cbe2 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784497.622366:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34800, rc 0) 00000100:00100000:1.0:1787784497.622398:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfeeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750039680:12345-0@lo:101: Request processed in 93us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784497.622403:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787784497.622533:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750039680:0@lo:101: 00010000:00010000:0.0:1787784497.622545:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cbe9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.622555:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cbe9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.622698:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750039936:0@lo:501: 00000100:00100000:0.0:1787784497.622725:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784497.622824:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f47840 going to sleep for 11 seconds 00000100:00100000:1.0:1787784497.623055:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750039936 00000100:00100000:1.0:1787784497.623059:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750039936 00000100:00100000:1.0:1787784497.623115:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787784497.623123:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750039936:12345-0@lo:501: 00000100:00100000:1.0:1787784497.623224:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750039936:12345-0@lo:501: Request processed in 101us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784497.623230:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787784497.623278:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750039936:0@lo:501: 00000100:00100000:0.0:1787784497.623305:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040064:0@lo:503: 00000100:00100000:0.0:1787784497.623343:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784497.623435:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f47840 going to sleep for 11 seconds 00000100:00100000:2.0:1787784497.623500:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750040064 00000100:00100000:2.0:1787784497.623505:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750040064 00000100:00100000:2.0:1787784497.623525:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787784497.623530:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750040064:12345-0@lo:503: 00000100:00100000:2.0:1787784497.623620:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750040064:12345-0@lo:503: Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.623626:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787784497.623746:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040064:0@lo:503: 00000040:00080000:0.0:1787784497.624030:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787784497.624100:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040192:0@lo:502: 00000100:00100000:0.0:1787784497.624136:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784497.624160:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f47840 going to sleep for 11 seconds 00000100:00100000:2.0:1787784497.624208:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750040192 00000100:00100000:2.0:1787784497.624212:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750040192 00000100:00100000:2.0:1787784497.624231:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787784497.624237:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750040192:12345-0@lo:502: 00000100:00100000:2.0:1787784497.624312:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750040192:12345-0@lo:502: Request processed in 74us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.624319:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787784497.624424:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040192:0@lo:502: 00000040:00080000:0.0:1787784497.624600:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787784497.624641:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787784497.624654:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787784497.624668:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787784497.624689:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787784497.624702:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787784497.624721:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040320:0@lo:502: 00000100:00100000:0.0:1787784497.624756:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784497.624806:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f47840 going to sleep for 11 seconds 00000100:00100000:1.0:1787784497.624927:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750040320 00000100:00100000:1.0:1787784497.624932:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750040320 00000100:00100000:1.0:1787784497.624984:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787784497.624991:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750040320:12345-0@lo:502: 00000100:00100000:1.0:1787784497.625070:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750040320:12345-0@lo:502: Request processed in 79us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784497.625077:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787784497.625246:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040320:0@lo:502: 00000040:00080000:0.0:1787784497.625286:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787784497.625294:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1787784497.625641:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787784497.625648:0:9525:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787784497.625654:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784497.625657:0:9525:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787784497.625663:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784497.625677:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8950c20c99b8) 00000020:00000080:0.0:1787784497.625699:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787784497.625706:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787784497.626028:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951f53b5800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787784497.626037:0:9525:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787784497.626045:0:9525:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x88ace7295d9cbf7 00010000:00010000:0.0:1787784497.634738:0:9525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1787784497.635122:0:9525:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787784497.638224:0:9525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787784497.638555:0:9525:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787784497.644187:0:9525:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787784497.644411:0:9525:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787784497.651600:0:9525:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787784497.653380:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787784497.653403:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784497.653410:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784497.653412:0:9525:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787784497.653416:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784497.653420:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784497.653422:0:9525:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787784497.653425:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787784497.653427:0:9525:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787784497.653458:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784497.653461:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784497.653462:0:9525:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787784497.653466:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787784497.653638:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787784497.653674:0:9514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787784497.653700:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cbe9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784497.653714:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cbe9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784497.653723:0:9514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951f53b5800 from 1 10000000:01000000:1.0:1787784497.653727:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787784497.653789:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784497.653798:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784497.653810:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784497.653836:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53cb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040448:0@lo:101: 00000100:00100000:1.0:1787784497.654151:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784497.654204:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9946c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784497.654258:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750040448 00000100:00100000:3.0:1787784497.654266:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750040448 00000100:00100000:3.0:1787784497.654322:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787784497.654333:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750040448:12345-0@lo:101: 00010000:00010000:3.0:1787784497.654351:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784497.654365:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c151fc00/0x88ace7295d9cc05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cbfe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.654390:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c151fc00/0x88ace7295d9cc05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cbfe expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.654402:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c151fc00/0x88ace7295d9cc05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cbfe expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.654411:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151fc00, rc 0) 00000100:00100000:3.0:1787784497.654455:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:9514:x1874627750040448:12345-0@lo:101: Request processed in 125us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.654463:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787784497.654542:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53cb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040448:0@lo:101: 00010000:00010000:1.0:1787784497.654557:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc05 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784497.654566:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cc05 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784497.654733:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53cb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040576:0@lo:501: 00000100:00100000:1.0:1787784497.654808:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784497.654827:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9946c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784497.654843:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750040576 00000100:00100000:1.0:1787784497.654847:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750040576 00000100:00100000:1.0:1787784497.654875:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787784497.654882:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:9514:x1874627750040576:12345-0@lo:501: 00000100:00100000:1.0:1787784497.655280:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:9514:x1874627750040576:12345-0@lo:501: Request processed in 398us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784497.655288:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787784497.655367:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53cb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040576:0@lo:501: 00000100:00100000:2.0:1787784497.655401:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040704:0@lo:503: 00000100:00100000:2.0:1787784497.655448:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.655480:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784497.655528:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750040704 00000100:00100000:3.0:1787784497.655539:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750040704 00000100:00100000:3.0:1787784497.655575:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787784497.655582:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:9514:x1874627750040704:12345-0@lo:503: 00000100:00100000:3.0:1787784497.655691:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:9514:x1874627750040704:12345-0@lo:503: Request processed in 109us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.655698:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787784497.656035:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040704:0@lo:503: 00000040:00080000:2.0:1787784497.656304:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784497.656394:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040832:0@lo:502: 00000100:00100000:2.0:1787784497.656443:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.658487:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e9480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784497.662993:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750040832 00000100:00100000:3.0:1787784497.663013:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750040832 00000100:00100000:3.0:1787784497.663089:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787784497.663100:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:9514:x1874627750040832:12345-0@lo:502: 00000100:00100000:3.0:1787784497.663287:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:9514:x1874627750040832:12345-0@lo:502: Request processed in 189us (6844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.663295:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787784497.663756:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040832:0@lo:502: 00000040:00080000:2.0:1787784497.664484:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787784497.664520:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787784497.664564:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040960:0@lo:502: 00000100:00100000:2.0:1787784497.664644:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.664682:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784497.664702:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750040960 00000100:00100000:2.0:1787784497.664707:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750040960 00000100:00100000:2.0:1787784497.664742:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787784497.664750:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:9514:x1874627750040960:12345-0@lo:502: 00000100:00100000:2.0:1787784497.664865:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:9514:x1874627750040960:12345-0@lo:502: Request processed in 115us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.664872:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787784497.664932:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750040960:0@lo:502: 00000040:00080000:2.0:1787784497.664987:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787784497.664995:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787784497.665904:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784497.665923:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784497.665926:0:9529:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787784497.665933:0:9529:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951f53b5800 00000020:00000080:3.0:1787784497.665936:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784497.665960:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784497.665964:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784497.665965:0:9529:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787784497.665969:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787784497.666193:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787784497.666219:0:9514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784497.666240:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc05 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.666252:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc05 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784497.666303:0:9514:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787784497.666306:0:9514:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8951f53b5800 10000000:01000000:2.0:1787784497.666309:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8951f53b5800 10000000:01000000:2.0:1787784497.666325:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784497.666331:0:9514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951f53b5800 from 1 10000000:01000000:2.0:1787784497.666334:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787784497.666365:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.666373:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784497.666386:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784497.666405:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750041088:0@lo:101: 00000100:00100000:2.0:1787784497.666460:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.666499:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784497.666628:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750041088 00000100:00100000:0.0:1787784497.666635:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750041088 00000100:00100000:0.0:1787784497.666670:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787784497.666678:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:9514:x1874627750041088:12345-0@lo:101: 00010000:00010000:0.0:1787784497.666691:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784497.666711:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cc13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cc0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.666735:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cc0c expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.666745:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cc0c expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.666753:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629a00, rc 0) 00000100:00100000:0.0:1787784497.666822:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:9514:x1874627750041088:12345-0@lo:101: Request processed in 144us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784497.666829:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787784497.667127:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750041088:0@lo:101: 00010000:00010000:3.0:1787784497.667143:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc13 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.667153:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cc13 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784497.667245:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750041216:0@lo:501: 00000100:00100000:3.0:1787784497.667276:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784497.667308:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f53eb480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784497.667360:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750041216 00000100:00100000:2.0:1787784497.667364:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750041216 00000100:00100000:2.0:1787784497.667397:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787784497.667405:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:9514:x1874627750041216:12345-0@lo:501: 00000100:00100000:2.0:1787784497.667514:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:9514:x1874627750041216:12345-0@lo:501: Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.667522:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787784497.667554:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750041216:0@lo:501: 00000100:00100000:2.0:1787784497.667581:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2363840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750041344:0@lo:503: 00000100:00100000:2.0:1787784497.667630:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.667642:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2aa6840 going to sleep for 11 seconds 00000100:00100000:2.0:1787784497.667652:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750041344 00000100:00100000:2.0:1787784497.667655:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750041344 00000100:00100000:2.0:1787784497.667669:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787784497.667680:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:9514:x1874627750041344:12345-0@lo:503: 00000100:00100000:2.0:1787784497.667746:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:9514:x1874627750041344:12345-0@lo:503: Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.667753:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787784497.667814:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2363840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750041344:0@lo:503: 00000040:00080000:2.0:1787784497.668153:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784497.668207:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2363840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750041472:0@lo:502: 00000100:00100000:2.0:1787784497.668243:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.668297:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784497.670528:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750041472 00000100:00100000:3.0:1787784497.670541:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750041472 00000100:00100000:3.0:1787784497.670609:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787784497.670620:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:9514:x1874627750041472:12345-0@lo:502: 00000100:00100000:3.0:1787784497.670809:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:9514:x1874627750041472:12345-0@lo:502: Request processed in 190us (2565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.670817:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:1.0:1787784497.672733:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784497.672862:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2363840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750041472:0@lo:502: 00000040:00080000:0.0:1787784497.673142:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787784497.673173:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787784497.673189:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787784497.673202:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787784497.673213:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787784497.673225:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787784497.673238:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787784497.673251:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787784497.673265:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787784497.673276:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787784497.673287:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787784497.673299:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787784497.673333:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787784497.673348:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787784497.673359:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787784497.673370:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787784497.673382:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787784497.673406:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787784497.673420:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787784497.673432:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787784497.673449:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787784497.673462:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787784497.673474:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787784497.673488:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787784497.673500:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787784497.673513:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787784497.673527:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787784497.673539:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787784497.673563:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787784497.673579:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787784497.673592:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787784497.673622:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787784497.673637:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787784497.673648:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787784497.673659:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787784497.673669:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787784497.673681:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1787784497.673694:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787784497.673706:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1787784497.673717:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1787784497.673729:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1787784497.673741:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1787784497.673753:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1787784497.673765:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1787784497.673824:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1787784497.673839:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1787784497.673881:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750041600:0@lo:502: 00000100:00100000:0.0:1787784497.673962:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784497.674005:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f473c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784497.674039:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750041600 00000100:00100000:0.0:1787784497.674045:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750041600 00000100:00100000:0.0:1787784497.674092:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787784497.674101:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:9514:x1874627750041600:12345-0@lo:502: 00000100:00100000:0.0:1787784497.674229:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:9514:x1874627750041600:12345-0@lo:502: Request processed in 128us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784497.674237:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787784497.674293:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750041600:0@lo:502: 00000040:00080000:0.0:1787784497.674333:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1787784497.674341:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1787784497.677048:0:9530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787784497.677067:0:9530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff895201d0cd28) 00000020:00000080:1.0:1787784497.677092:0:9530:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1787784497.677200:0:9530:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951f53b5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787784497.677204:0:9530:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951f53b5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787784497.677206:0:9530:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951f53b5800 3 00010000:00080000:1.0:1787784497.677236:0:9530:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951d87ad000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1787784497.681259:0:9530:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1787784497.681535:0:9530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787784497.681587:0:9530:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787784497.681680:0:9530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x88ace7295d9cc21 00000100:00080000:1.0:1787784497.681693:0:9530:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784497.681699:0:9530:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8951d87ad000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784497.681740:0:9530:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951f53ca940 x1874627750041728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784497.681814:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750041728:0@lo:38: 00000100:00100000:3.0:1787784497.681908:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.682104:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750041728 00000100:00100000:2.0:1787784497.682114:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750041728 00000100:00100000:2.0:1787784497.682162:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784497.682171:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874627750041728:12345-0@lo:38: 00010000:00080000:2.0:1787784497.682199:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1787784497.682233:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x88ace7295d9cc28 00000004:00100000:2.0:1787784497.682252:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787784497.682287:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8951ff43c800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787784497.682380:0:9530:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787784497.686846:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874627750041728:12345-0@lo:38: Request processed in 4665us (4928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.686863:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784497.687028:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750042240:0@lo:400: 00000100:00100000:2.0:1787784497.687098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.687178:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750042752:0@lo:400: 00000100:00100000:2.0:1787784497.687203:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.687226:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787784497.687232:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750042112:0@lo:400: 00000100:00100000:2.0:1787784497.687266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.687285:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750042624:0@lo:400: 00000100:00100000:2.0:1787784497.687302:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.687332:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750042752 00000100:00100000:2.0:1787784497.687339:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750042752 00000100:00100000:2.0:1787784497.687382:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750042624 00000100:00100000:2.0:1787784497.687385:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750042624 00000100:00100000:2.0:1787784497.687408:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784497.687418:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750042752:12345-0@lo:400: 00000100:00100000:2.0:1787784497.687468:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750042752:12345-0@lo:400: Request processed in 52us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.687474:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784497.687484:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784497.687489:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750042624:12345-0@lo:400: 00000100:00100000:2.0:1787784497.687510:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750042624:12345-0@lo:400: Request processed in 21us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.687514:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784497.687527:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750042112 00000100:00100000:2.0:1787784497.687530:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750042112 00000100:00100000:2.0:1787784497.687550:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787784497.687555:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750042112:12345-0@lo:400: 00000100:00100000:2.0:1787784497.687581:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750042112:12345-0@lo:400: Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.687585:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787784497.687600:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784497.687633:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3271e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750041984:0@lo:400: 00000100:00100000:2.0:1787784497.687661:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787784497.687746:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53ca940 x1874627750041728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784497.687757:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787784497.687781:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787784497.687789:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787784497.687794:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787784497.687798:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951d87ad000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787784497.687806:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750041728:0@lo:38: 00000100:00100000:3.0:1787784497.691278:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750041856:0@lo:400: 00000100:00100000:3.0:1787784497.691360:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784497.691395:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3271a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750042368:0@lo:400: 00000100:00100000:3.0:1787784497.691417:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.691620:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750042496:0@lo:400: 00000100:00100000:2.0:1787784497.691645:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.691681:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750041856 00000100:00100000:2.0:1787784497.691687:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750041856 00000100:00100000:2.0:1787784497.691731:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750042368 00000100:00100000:2.0:1787784497.691734:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750042368 00000100:00100000:2.0:1787784497.691756:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750042496 00000100:00100000:2.0:1787784497.691759:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750042496 00000100:00100000:2.0:1787784497.691799:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787784497.691807:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750041856:12345-0@lo:400: 00000100:00100000:2.0:1787784497.691863:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750041856:12345-0@lo:400: Request processed in 56us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.691870:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787784497.691885:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787784497.691898:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750042368:12345-0@lo:400: 00000100:00100000:2.0:1787784497.691926:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750042368:12345-0@lo:400: Request processed in 37us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.691932:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787784497.691944:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787784497.691960:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750042496:12345-0@lo:400: 00000100:00100000:2.0:1787784497.691993:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750042496:12345-0@lo:400: Request processed in 44us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.691999:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787784497.692017:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784497.692021:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787784497.692181:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3270000 x1874627750042112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784497.692198:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750042112:0@lo:400: 00010000:00080000:2.0:1787784497.692221:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3273480 x1874627750042624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784497.692231:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750042624:0@lo:400: 00010000:00080000:2.0:1787784497.692243:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c32703c0 x1874627750042752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784497.692251:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750042752:0@lo:400: 00010000:00080000:2.0:1787784497.692281:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53cb0c0 x1874627750041856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784497.692291:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750041856:0@lo:400: 00010000:00080000:2.0:1787784497.692299:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3271a40 x1874627750042368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784497.692306:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3271a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750042368:0@lo:400: 00010000:00080000:2.0:1787784497.692347:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3270780 x1874627750042496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784497.692357:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750042496:0@lo:400: 00000100:00100000:0.0:1787784497.692880:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750042240 00000100:00100000:0.0:1787784497.692886:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750042240 00000100:00100000:0.0:1787784497.692928:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750041984 00000100:00100000:0.0:1787784497.692931:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750041984 00000100:00100000:0.0:1787784497.692946:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787784497.692963:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2363840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750042240:12345-0@lo:400: 00000100:00100000:0.0:1787784497.693025:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2363840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750042240:12345-0@lo:400: Request processed in 62us (5927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784497.693031:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787784497.693045:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784497.693051:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750041984:12345-0@lo:400: 00000100:00100000:0.0:1787784497.693088:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750041984:12345-0@lo:400: Request processed in 37us (5426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784497.693094:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784497.693122:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3271e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750041984:0@lo:400: 00000100:00100000:2.0:1787784497.693233:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750042240:0@lo:400: 00000020:01000004:1.0:1787784497.693763:0:9530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787784497.693809:0:9530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff895201d08000) 00000020:00000080:1.0:1787784497.693845:0:9530:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1787784497.693993:0:9530:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951f53b5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787784497.693997:0:9530:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951f53b5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787784497.694000:0:9530:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951f53b5800 3 00010000:00080000:1.0:1787784497.694029:0:9530:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951f50d8000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1787784497.696535:0:9530:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:2.0:1787784497.696842:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f6d00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9532:1874627750042880:0@lo:901: 00000100:00100000:2.0:1787784497.696946:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.697019:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750042880 00000100:00100000:2.0:1787784497.697025:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750042880 00000100:00100000:2.0:1787784497.697080:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784497.697089:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9532:x1874627750042880:12345-0@lo:901: 00000100:00100000:2.0:1787784497.697177:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9532:x1874627750042880:12345-0@lo:901: Request processed in 89us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.697191:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787784497.697213:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784497.697225:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66d300 going to sleep for 11 seconds 00010000:00080000:2.0:1787784497.697248:0:9532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c19f6d00 x1874627750042880/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787784513 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784497.697263:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f6d00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9532:1874627750042880:0@lo:901: 00000020:00000080:1.0:1787784497.697747:0:9530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787784497.697811:0:9530:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787784497.697822:0:9530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x88ace7295d9cc36 00000100:00080000:1.0:1787784497.697830:0:9530:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784497.697836:0:9530:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8951f50d8000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784497.697859:0:9530:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c3272580 x1874627750043008/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784497.697878:0:9530:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787784497.698077:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874627750043008:0@lo:38: 00000100:00100000:2.0:1787784497.698114:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784497.698230:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750043008 00000100:00100000:2.0:1787784497.698235:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750043008 00000100:00100000:2.0:1787784497.698260:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784497.698266:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874627750043008:12345-0@lo:38: 00010000:00080000:2.0:1787784497.698286:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1787784497.698327:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x88ace7295d9cc3d 00000004:00100000:2.0:1787784497.698344:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787784497.698373:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8951ff43a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784497.698417:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874627750043008:12345-0@lo:38: Request processed in 150us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784497.698424:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787784497.698455:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3272580 x1874627750043008/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784497.698464:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784497.698471:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787784497.698478:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787784497.698481:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787784497.698490:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f50d8000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787784497.698496:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874627750043008:0@lo:38: 00000040:00080000:2.0:1787784497.699010:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1787784497.699303:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1787784497.699332:0:9514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787784497.699393:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc13 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.699405:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc13 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787784497.699453:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787784497.699455:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787784497.699456:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784497.699458:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784497.699459:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784497.699460:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784497.699462:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784497.699463:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787784497.699464:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787784497.699466:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784497.699468:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787784497.699472:0:9514:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787784497.699474:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787784497.699476:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787784497.699477:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784497.699478:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784497.699479:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784497.699480:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784497.699481:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784497.699482:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787784497.699483:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787784497.699484:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784497.699485:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787784497.699504:0:9514:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787784497.699517:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750043136:0@lo:253: 00000100:00100000:0.0:1787784497.699567:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784497.699617:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f473c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784497.701705:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750043136 00000100:00100000:1.0:1787784497.701720:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750043136 00000100:00100000:1.0:1787784497.701863:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787784497.701873:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:9514:x1874627750043136:12345-0@lo:253: 20000000:01000000:1.0:1787784497.701917:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787784497.701932:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787784497.710187:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787784497.710206:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787784497.710244:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787784497.710249:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787784497.710276:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.710313:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c13fec00/0x88ace7295d9cb3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cb33 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.710321:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff895201c5b800/0x88ace7295d9cb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cb79 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.710328:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.710373:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff895201c5b800/0x88ace7295d9cb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cb79 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.710391:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff895201c5b800/0x88ace7295d9cb80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cb79 expref: 17 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.710407:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750043264:0@lo:104: 00000100:00100000:0.0:1787784497.710475:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784497.710529:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c13fec00/0x88ace7295d9cb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cb33 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.710538:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951c13fec00/0x88ace7295d9cb3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cb33 expref: 17 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784497.710546:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260a580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750043392:0@lo:104: 00000100:00100000:0.0:1787784497.710567:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784497.710586:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24dab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784497.710660:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750043264 00000100:00100000:3.0:1787784497.710669:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750043264 00000100:00100000:3.0:1787784497.710713:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750043392 00000100:00100000:3.0:1787784497.710716:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750043392 00000100:00100000:3.0:1787784497.710729:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784497.710737:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2609a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:6537:x1874627750043264:12345-0@lo:104: 00010000:00010000:3.0:1787784497.710751:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cb80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.710844:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784497.710850:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2609a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:6537:x1874627750043264:12345-0@lo:104: Request processed in 114us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.710857:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784497.710874:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787784497.710880:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:6537:x1874627750043392:12345-0@lo:104: 00010000:00010000:3.0:1787784497.710887:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cb3a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.710929:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787784497.710934:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:6537:x1874627750043392:12345-0@lo:104: Request processed in 54us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.710940:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787784497.710968:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784497.710974:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cb80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.710982:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151e400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784497.710986:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cb80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711008:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cb80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784497.711016:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cb80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784497.711021:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787784497.711053:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711059:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784497.711076:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711083:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cb79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711095:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784497.711098:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cb3a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711103:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628600 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784497.711105:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cb3a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711111:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cb3a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784497.711117:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cb3a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784497.711129:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787784497.711144:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb3a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711150:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784497.711155:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb3a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711162:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9cb33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cb3a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711177:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784497.711179:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784497.711180:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784497.711380:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750043648:0@lo:103: 00000100:00100000:0.0:1787784497.711417:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784497.711464:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784497.711471:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750043520:0@lo:103: 00000100:00100000:0.0:1787784497.711492:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784497.711535:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750043264:0@lo:104: 00000100:00100000:0.0:1787784497.711544:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260a580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874627750043392:0@lo:104: 00010000:00010000:0.0:1787784497.711564:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784497.711684:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750043648 00000100:00100000:3.0:1787784497.711690:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750043648 00010000:00010000:3.0:1787784497.711711:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c13fec00/0x88ace7295d9cb3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cb33 expref: 18 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784497.711742:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750043520 00000100:00100000:3.0:1787784497.711745:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750043520 00010000:00010000:3.0:1787784497.711756:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff895201c5b800/0x88ace7295d9cb80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cb79 expref: 19 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784497.711799:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784497.711806:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+19:3645:x1874627750043648:12345-0@lo:103: 00010000:00010000:3.0:1787784497.711817:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784497.711822:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c13fec00/0x88ace7295d9cb3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cb33 expref: 19 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711843:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c13fec00/0x88ace7295d9cb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cb33 expref: 19 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711859:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c13fec00/0x88ace7295d9cb3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cb33 expref: 19 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711872:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784497.711910:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+18:3645:x1874627750043648:12345-0@lo:103: Request processed in 104us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.711916:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784497.711929:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787784497.711935:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2608f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+17:3645:x1874627750043520:12345-0@lo:103: 00010000:00010000:3.0:1787784497.711943:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784497.711957:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff895201c5b800/0x88ace7295d9cb80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cb79 expref: 17 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711967:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff895201c5b800/0x88ace7295d9cb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cb79 expref: 17 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711977:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5b800/0x88ace7295d9cb80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cb79 expref: 17 pid: 6513 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711988:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.711996:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787784497.712010:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012428030s 00010000:00010000:3.0:1787784497.712022:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.712029:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.712036:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.712042:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.712047:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784497.712052:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.712059:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.712071:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784497.712080:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784497.712103:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2608f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+16:3645:x1874627750043520:12345-0@lo:103: Request processed in 169us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784497.712110:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787784497.712268:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750043520:0@lo:103: 00000100:00100000:0.0:1787784497.712276:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750043648:0@lo:103: 00010000:00010000:0.0:1787784497.712296:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.712304:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.712311:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629200/0x88ace7295d9cc44 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784497.712859:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784497.713283:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+15:9514:x1874627750043136:12345-0@lo:253: Request processed in 11409us (13713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784497.713294:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787784497.713387:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee96db03-39cf-4d18-a974-880a628ded6e:9514:1874627750043136:0@lo:253: 10000000:01000000:2.0:1787784497.713400:0:9514:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787784497.713403:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784497.713404:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784497.713405:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784497.713407:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784497.713408:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784497.713409:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784497.713411:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784497.713412:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784497.713414:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784497.713416:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784497.713417:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787784497.713427:0:9514:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787784497.719352:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787784497.719532:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787784497.719849:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787784497.720074:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787784497.720283:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787784497.720504:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1787784497.722086:0:9514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787784497.729366:0:9514:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787784497.729376:0:9514:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787784497.729408:0:9514:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787784497.729443:0:9514:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787784497.729460:0:9514:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1787784497.729482:0:9514:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1787784497.730640:0:9514:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784497.730848:0:9514:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:3.0:1787784498.516230:0:9586:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787784498.516493:0:9586:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787784498.695919:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784499.335137:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750043776:0@lo:13: 00000100:00100000:0.0:1787784499.335248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784499.335323:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750043776 00000100:00100000:0.0:1787784499.335330:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750043776 00000100:00100000:0.0:1787784499.335395:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787784499.335405:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750043776:12345-0@lo:13: 00002000:00000024:0.0:1787784499.335433:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784499.335478:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750043776:12345-0@lo:13: Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784499.335485:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787784499.335524:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c260a580 x1874627750043776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784499.335539:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750043776:0@lo:13: 00000100:00100000:2.0:1787784499.337322:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750043904:0@lo:41: 00000100:00100000:2.0:1787784499.337380:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787784499.337426:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784499.337435:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784499.337442:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750044032:0@lo:13: 00000100:00100000:2.0:1787784499.337466:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784499.337500:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750043904 00000100:00100000:2.0:1787784499.337506:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750043904 00000100:00100000:2.0:1787784499.337544:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787784499.337552:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750043904:12345-0@lo:41: 00000004:00000024:2.0:1787784499.337579:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787784499.337631:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750043904:12345-0@lo:41: Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784499.337637:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787784499.337676:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750043904:0@lo:41: 00000100:00100000:2.0:1787784499.337702:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750044032 00000100:00100000:2.0:1787784499.337705:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750044032 00000100:00100000:2.0:1787784499.337733:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784499.337738:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750044032:12345-0@lo:13: 00002000:00000024:2.0:1787784499.337751:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784499.337796:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750044032:12345-0@lo:13: Request processed in 58us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784499.337802:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787784499.337921:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787784499.337949:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d9e130c0 x1874627750044032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784499.337964:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750044032:0@lo:13: 00010000:00010000:0.0:1787784499.719964:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784500.742740:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784501.383549:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784501.383574:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750044160:0@lo:41: 00000100:00100000:0.0:1787784501.383641:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784501.383701:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750044160 00000100:00100000:0.0:1787784501.383708:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750044160 00000100:00100000:0.0:1787784501.383755:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787784501.383763:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2609680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750044160:12345-0@lo:41: 00000004:00000024:0.0:1787784501.383830:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1787784501.383880:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2609680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750044160:12345-0@lo:41: Request processed in 117us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784501.383887:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787784501.383943:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750044160:0@lo:41: 00010000:00010000:0.0:1787784501.768958:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784502.790268:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784502.924307:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750044288:0@lo:400: 00000100:00100000:0.0:1787784502.924380:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784502.924879:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750044288 00000100:00100000:3.0:1787784502.924887:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750044288 00000100:00100000:3.0:1787784502.924943:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787784502.924951:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:3646:x1874627750044288:12345-0@lo:400: 00000100:00100000:2.0:1787784502.929386:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750044416:0@lo:400: 00000100:00100000:2.0:1787784502.929458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784502.929486:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750044928:0@lo:400: 00000100:00100000:2.0:1787784502.929504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784502.929518:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750045440:0@lo:400: 00000100:00100000:2.0:1787784502.929535:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784502.929553:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787784502.929559:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750044800:0@lo:400: 00000100:00100000:2.0:1787784502.929580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784502.929595:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3411680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750045312:0@lo:400: 00000100:00100000:2.0:1787784502.929615:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784502.929637:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750044544:0@lo:400: 00000100:00100000:2.0:1787784502.929657:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784502.929671:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750045056:0@lo:400: 00000100:00100000:2.0:1787784502.929688:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784502.929701:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750045568:0@lo:400: 00000100:00100000:2.0:1787784502.929717:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784502.929727:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787784502.929732:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750044672:0@lo:400: 00000100:00100000:2.0:1787784502.929761:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784502.929895:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750045184:0@lo:400: 00000100:00100000:2.0:1787784502.929929:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784502.930017:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750044416 00000100:00100000:2.0:1787784502.930026:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750044416 00000100:00100000:2.0:1787784502.930066:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750044928 00000100:00100000:2.0:1787784502.930076:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750044928 00000100:00100000:2.0:1787784502.930099:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750045440 00000100:00100000:2.0:1787784502.930101:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750045440 00000100:00100000:2.0:1787784502.930111:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750045056 00000100:00100000:2.0:1787784502.930112:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750045056 00000100:00100000:2.0:1787784502.930122:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750045568 00000100:00100000:2.0:1787784502.930124:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750045568 00000100:00100000:2.0:1787784502.930133:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750044672 00000100:00100000:2.0:1787784502.930135:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750044672 00000100:00100000:2.0:1787784502.930147:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787784502.930155:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750044416:12345-0@lo:400: 00000100:00100000:2.0:1787784502.930215:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750044416:12345-0@lo:400: Request processed in 60us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784502.930223:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787784502.930241:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787784502.930248:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750044928:12345-0@lo:400: 00000100:00100000:2.0:1787784502.930274:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750044928:12345-0@lo:400: Request processed in 27us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784502.930280:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787784502.930291:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787784502.930296:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750045440:12345-0@lo:400: 00000100:00100000:2.0:1787784502.930321:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750045440:12345-0@lo:400: Request processed in 25us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784502.930326:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787784502.930335:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787784502.930341:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750045056:12345-0@lo:400: 00000100:00100000:2.0:1787784502.930369:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750045056:12345-0@lo:400: Request processed in 28us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784502.930383:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787784502.930394:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787784502.930400:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750045568:12345-0@lo:400: 00000100:00100000:2.0:1787784502.930429:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750045568:12345-0@lo:400: Request processed in 29us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784502.930433:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787784502.930443:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787784502.930448:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750044672:12345-0@lo:400: 00000100:00100000:2.0:1787784502.930470:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750044672:12345-0@lo:400: Request processed in 22us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784502.930475:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787784502.930497:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750044800 00000100:00100000:2.0:1787784502.930500:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750044800 00000100:00100000:2.0:1787784502.930516:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750044544 00000100:00100000:2.0:1787784502.930519:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750044544 00000100:00100000:2.0:1787784502.930529:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787784502.930534:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750044800:12345-0@lo:400: 00000100:00100000:2.0:1787784502.930565:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750044800:12345-0@lo:400: Request processed in 30us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784502.930571:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787784502.930581:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787784502.930587:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750044544:12345-0@lo:400: 00000100:00100000:2.0:1787784502.930613:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750044544:12345-0@lo:400: Request processed in 26us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784502.930618:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787784502.930634:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750045312 00000100:00100000:2.0:1787784502.930641:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750045312 00000100:00100000:2.0:1787784502.930662:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750045184 00000100:00100000:2.0:1787784502.930664:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750045184 00000100:00100000:2.0:1787784502.930679:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784502.930684:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750045312:12345-0@lo:400: 00000100:00100000:2.0:1787784502.930709:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750045312:12345-0@lo:400: Request processed in 26us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784502.930715:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784502.930723:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784502.930728:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750045184:12345-0@lo:400: 00000100:00100000:2.0:1787784502.930745:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750045184:12345-0@lo:400: Request processed in 18us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784502.930750:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787784502.932021:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787784502.932030:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784502.932033:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784502.932071:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750044800:0@lo:400: 00010000:00080000:2.0:1787784502.932088:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3411680 x1874627750045312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784502.932100:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3411680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750045312:0@lo:400: 00010000:00080000:2.0:1787784502.932110:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d9e112c0 x1874627750044416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784502.932120:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750044416:0@lo:400: 00010000:00080000:2.0:1787784502.932130:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c34121c0 x1874627750044928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784502.932139:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750044928:0@lo:400: 00010000:00080000:2.0:1787784502.932162:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3412940 x1874627750045440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784502.932170:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750045440:0@lo:400: 00010000:00080000:2.0:1787784502.932213:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3412580 x1874627750044672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784502.932223:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750044672:0@lo:400: 00010000:00080000:2.0:1787784502.932234:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3413840 x1874627750045184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784502.932241:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750045184:0@lo:400: 00000100:00100000:2.0:1787784502.932252:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750044544:0@lo:400: 00010000:00080000:2.0:1787784502.932263:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3410f00 x1874627750045056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784502.932271:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750045056:0@lo:400: 00010000:00080000:2.0:1787784502.932282:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3413c00 x1874627750045568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784502.932290:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750045568:0@lo:400: 00000100:00100000:3.0:1787784502.932687:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:3646:x1874627750044288:12345-0@lo:400: Request processed in 7734us (8305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784502.932699:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787784502.934017:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750044288:0@lo:400: 00000001:02000400:2.0:1787784503.498683:0:9876:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787784503.817469:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787784504.454326:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787784504.454335:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951efedf000 from 39 10000000:01000000:3.0:1787784504.454340:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787784504.454387:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.454400:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.454410:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784504.454435:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750045696:0@lo:101: 00000100:00100000:3.0:1787784504.454508:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.454577:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f0114480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784504.456446:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750045696 00000100:00100000:0.0:1787784504.456458:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750045696 00000100:00100000:0.0:1787784504.456515:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787784504.456526:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750045696:12345-0@lo:101: 00010000:00010000:0.0:1787784504.456545:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784504.456563:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1628400/0x88ace7295d9cc52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cc4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784504.456595:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1628400/0x88ace7295d9cc52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cc4b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784504.456606:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1628400/0x88ace7295d9cc52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cc4b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784504.456616:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628400, rc 0) 00000100:00100000:0.0:1787784504.456717:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750045696:12345-0@lo:101: Request processed in 193us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784504.456724:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787784504.456949:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750045696:0@lo:101: 00010000:00010000:3.0:1787784504.456968:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.456978:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cc52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784504.457047:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750045952:0@lo:501: 00000100:00100000:3.0:1787784504.457083:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.457115:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f0114480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.457142:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750045952 00000100:00100000:3.0:1787784504.457146:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750045952 00000100:00100000:3.0:1787784504.457175:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787784504.457183:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750045952:12345-0@lo:501: 00000100:00100000:1.0:1787784504.457294:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784504.457307:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750045952:12345-0@lo:501: Request processed in 123us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.457311:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750045824:0@lo:13: 00000100:00100000:3.0:1787784504.457319:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787784504.457355:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.457361:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750045952:0@lo:501: 00000100:00100000:3.0:1787784504.457393:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750046080:0@lo:503: 00000100:00100000:1.0:1787784504.457400:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750045824 00000100:00100000:1.0:1787784504.457406:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750045824 00000100:00100000:3.0:1787784504.457441:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.457450:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784504.457459:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f0114480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784504.457460:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750045824:12345-0@lo:13: 00000100:00100000:3.0:1787784504.457475:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750046080 00000100:00100000:3.0:1787784504.457480:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750046080 00002000:00000024:1.0:1787784504.457492:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784504.457507:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787784504.457516:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750046080:12345-0@lo:503: 00000100:00100000:1.0:1787784504.457536:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750045824:12345-0@lo:13: Request processed in 78us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.457555:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787784504.457576:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787784504.457605:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f5315a40 x1874627750045824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784504.457607:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750046080:12345-0@lo:503: Request processed in 91us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.457625:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787784504.457633:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750045824:0@lo:13: 00000100:00100000:3.0:1787784504.457672:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750046080:0@lo:503: 00000100:00100000:0.0:1787784504.459872:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750046208:0@lo:13: 00000100:00100000:0.0:1787784504.459963:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.460222:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784504.460232:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750046336:0@lo:41: 00000100:00100000:1.0:1787784504.460266:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.460297:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750046208 00000100:00100000:1.0:1787784504.460304:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750046208 00000100:00100000:1.0:1787784504.460372:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784504.460382:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750046208:12345-0@lo:13: 00000100:00080000:0.0:1787784504.460570:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787784504.460608:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784504.460676:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750046208:12345-0@lo:13: Request processed in 295us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.460683:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787784504.460928:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c260b840 x1874627750046208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784504.460949:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750046208:0@lo:13: 00000100:00100000:2.0:1787784504.461135:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750046336 00000100:00100000:2.0:1787784504.461140:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750046336 00000100:00100000:2.0:1787784504.461183:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787784504.461190:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750046336:12345-0@lo:41: 00000004:00000024:2.0:1787784504.461217:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787784504.461277:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750046336:12345-0@lo:41: Request processed in 88us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.461282:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787784504.461332:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750046336:0@lo:41: 00000100:00100000:2.0:1787784504.463404:0:9910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9910:1874627750046464:0@lo:502: 00000100:00100000:2.0:1787784504.463492:0:9910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.463537:0:9910:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.463642:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750046464 00000100:00100000:3.0:1787784504.463652:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750046464 00000100:00100000:3.0:1787784504.463710:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787784504.463720:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:9910:x1874627750046464:12345-0@lo:502: 00000100:00100000:3.0:1787784504.463877:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:9910:x1874627750046464:12345-0@lo:502: Request processed in 158us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.463884:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787784504.464140:0:9910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9910:1874627750046464:0@lo:502: 00000100:00100000:2.0:1787784504.464187:0:9910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9910:1874627750046592:0@lo:502: 00000100:00100000:2.0:1787784504.464223:0:9910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.464252:0:9910:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.464296:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750046592 00000100:00100000:3.0:1787784504.464300:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750046592 00000100:00100000:3.0:1787784504.464365:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787784504.464373:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:9910:x1874627750046592:12345-0@lo:502: 00000100:00100000:3.0:1787784504.464447:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:9910:x1874627750046592:12345-0@lo:502: Request processed in 74us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.464454:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787784504.464508:0:9910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9910:1874627750046592:0@lo:502: 00000040:00080000:2.0:1787784504.464525:0:9910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787784504.467835:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787784504.467874:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787784504.467896:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.467917:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784504.467928:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787784504.467931:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787784504.467933:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787784504.467983:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.467990:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.468010:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784504.468036:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750046720:0@lo:101: 00000100:00100000:2.0:1787784504.468116:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.468163:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784504.468182:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750046720 00000100:00100000:1.0:1787784504.468190:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750046720 00000100:00100000:1.0:1787784504.468252:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787784504.468263:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750046720:12345-0@lo:101: 00010000:00010000:1.0:1787784504.468283:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784504.468301:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34400/0x88ace7295d9cc60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cc59 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.468343:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34400/0x88ace7295d9cc60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cc59 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.468353:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34400/0x88ace7295d9cc60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cc59 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.468363:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34400, rc 0) 00000100:00100000:1.0:1787784504.468498:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750046720:12345-0@lo:101: Request processed in 236us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.468504:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787784504.471924:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750046720:0@lo:101: 00010000:00010000:2.0:1787784504.471963:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.471978:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cc60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784504.472157:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750046848:0@lo:501: 00000100:00100000:3.0:1787784504.472229:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.472273:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c22476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784504.472327:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750046848 00000100:00100000:2.0:1787784504.472333:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750046848 00000100:00100000:2.0:1787784504.472389:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787784504.472398:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750046848:12345-0@lo:501: 00000100:00100000:2.0:1787784504.472545:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750046848:12345-0@lo:501: Request processed in 147us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.472552:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787784504.472682:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750046848:0@lo:501: 00000100:00100000:3.0:1787784504.472710:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750046976:0@lo:503: 00000100:00100000:3.0:1787784504.472757:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.472825:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c22476c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784504.472907:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750046976 00000100:00100000:0.0:1787784504.472921:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750046976 00000100:00100000:0.0:1787784504.472944:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787784504.472959:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750046976:12345-0@lo:503: 00000100:00100000:0.0:1787784504.473037:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750046976:12345-0@lo:503: Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784504.473044:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787784504.473257:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750046976:0@lo:503: 00000100:00100000:2.0:1787784504.474271:0:9912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9912:1874627750047104:0@lo:502: 00000100:00100000:2.0:1787784504.474328:0:9912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.474376:0:9912:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355600 going to sleep for 11 seconds 00000100:00100000:0.0:1787784504.474470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750047104 00000100:00100000:0.0:1787784504.474476:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750047104 00000100:00100000:0.0:1787784504.474519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787784504.474528:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+17:9912:x1874627750047104:12345-0@lo:502: 00000100:00100000:0.0:1787784504.474636:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+17:9912:x1874627750047104:12345-0@lo:502: Request processed in 108us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784504.474644:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787784504.474720:0:9912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9912:1874627750047104:0@lo:502: 00000020:01000000:2.0:1787784504.474745:0:9912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784504.474754:0:9912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784504.474762:0:9912:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784504.474799:0:9912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784504.474802:0:9912:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787784504.474819:0:9912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9912:1874627750047232:0@lo:502: 00000100:00100000:2.0:1787784504.474850:0:9912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.474870:0:9912:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355600 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.474934:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750047232 00000100:00100000:3.0:1787784504.474939:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750047232 00000100:00100000:3.0:1787784504.474976:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787784504.474983:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:9912:x1874627750047232:12345-0@lo:502: 00000100:00100000:3.0:1787784504.475057:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:9912:x1874627750047232:12345-0@lo:502: Request processed in 74us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.475063:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787784504.475130:0:9912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9912:1874627750047232:0@lo:502: 00000020:01000000:2.0:1787784504.475149:0:9912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784504.475153:0:9912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784504.475155:0:9912:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787784504.475159:0:9912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787784504.475346:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787784504.475377:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787784504.475387:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.475409:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784504.475420:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787784504.475422:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951cfe95800 from 39 10000000:01000000:3.0:1787784504.475425:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787784504.475449:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.475457:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.475466:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784504.475478:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750047360:0@lo:101: 00000100:00100000:3.0:1787784504.475507:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.475538:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247840 going to sleep for 11 seconds 00000100:00100000:2.0:1787784504.475644:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750047360 00000100:00100000:2.0:1787784504.475648:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750047360 00000100:00100000:2.0:1787784504.475681:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787784504.475688:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750047360:12345-0@lo:101: 00010000:00010000:2.0:1787784504.475698:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784504.475711:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5b400/0x88ace7295d9cc6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cc67 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.475735:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5b400/0x88ace7295d9cc6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cc67 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.475745:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5b400/0x88ace7295d9cc6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cc67 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.475753:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5b400, rc 0) 00000100:00100000:2.0:1787784504.475815:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750047360:12345-0@lo:101: Request processed in 127us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.475821:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787784504.485343:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750047360:0@lo:101: 00010000:00010000:3.0:1787784504.485376:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.485390:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cc6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784504.485488:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750047488:0@lo:501: 00000100:00100000:3.0:1787784504.485551:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.485600:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750047488 00000100:00100000:3.0:1787784504.485606:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750047488 00000100:00100000:3.0:1787784504.485646:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787784504.485655:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750047488:12345-0@lo:501: 00000100:00100000:3.0:1787784504.485804:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750047488:12345-0@lo:501: Request processed in 149us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.485812:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787784504.485854:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.485866:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750047488:0@lo:501: 00000100:00100000:3.0:1787784504.485905:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750047616:0@lo:503: 00000100:00100000:3.0:1787784504.485953:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.485973:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750047616 00000100:00100000:3.0:1787784504.485976:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750047616 00000100:00100000:3.0:1787784504.485995:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787784504.486001:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750047616:12345-0@lo:503: 00000100:00100000:3.0:1787784504.486066:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750047616:12345-0@lo:503: Request processed in 64us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.486072:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787784504.486102:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.486113:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750047616:0@lo:503: 00000100:00100000:3.0:1787784504.486279:0:9915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9915:1874627750047744:0@lo:502: 00000100:00100000:3.0:1787784504.486307:0:9915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.486325:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750047744 00000100:00100000:3.0:1787784504.486329:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750047744 00000100:00100000:3.0:1787784504.486348:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787784504.486353:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:9915:x1874627750047744:12345-0@lo:502: 00000100:00100000:3.0:1787784504.486426:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:9915:x1874627750047744:12345-0@lo:502: Request processed in 71us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.486432:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787784504.486459:0:9915:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.486470:0:9915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9915:1874627750047744:0@lo:502: 00000100:00100000:3.0:1787784504.486507:0:9915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9915:1874627750047872:0@lo:502: 00000100:00100000:3.0:1787784504.486539:0:9915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.486556:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750047872 00000100:00100000:3.0:1787784504.486559:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750047872 00000100:00100000:3.0:1787784504.486580:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787784504.486586:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+18:9915:x1874627750047872:12345-0@lo:502: 00000100:00100000:3.0:1787784504.486643:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+18:9915:x1874627750047872:12345-0@lo:502: Request processed in 57us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.486650:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787784504.486676:0:9915:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.486687:0:9915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9915:1874627750047872:0@lo:502: 00000040:00080000:3.0:1787784504.486702:0:9915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787784504.486750:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787784504.486765:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787784504.486794:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.486804:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784504.486813:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787784504.486821:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951cfe95800 from 6 10000000:01000000:3.0:1787784504.486824:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787784504.486849:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.486857:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.486865:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784504.486876:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750048000:0@lo:101: 00000100:00100000:3.0:1787784504.486914:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.486928:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.486941:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750048000 00000100:00100000:3.0:1787784504.486944:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750048000 00000100:00100000:3.0:1787784504.486965:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787784504.486971:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750048000:12345-0@lo:101: 00010000:00010000:3.0:1787784504.486978:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784504.486989:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c151f800/0x88ace7295d9cc7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cc75 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.487007:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c151f800/0x88ace7295d9cc7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cc75 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.487015:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c151f800/0x88ace7295d9cc7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cc75 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.487023:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151f800, rc 0) 00000100:00100000:3.0:1787784504.487050:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750048000:12345-0@lo:101: Request processed in 79us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.487062:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787784504.487093:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750048000:0@lo:101: 00010000:00010000:3.0:1787784504.487104:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.487112:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784504.487154:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750048128:0@lo:256: 00000100:00100000:3.0:1787784504.487181:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.487195:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.487206:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750048128 00000100:00100000:3.0:1787784504.487209:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750048128 00000100:00100000:3.0:1787784504.487231:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787784504.487237:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750048128:12345-0@lo:256: 20000000:01000000:3.0:1787784504.487249:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787784504.487265:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787784504.487267:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787784504.487339:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750048128:12345-0@lo:256: Request processed in 102us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.487346:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787784504.487370:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750048128:0@lo:256: 10000000:01000000:3.0:1787784504.487406:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787784504.487412:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.487419:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784504.487433:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787784504.487434:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1787784504.487436:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787784504.487451:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.487458:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.487465:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784504.487476:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750048256:0@lo:101: 00000100:00100000:3.0:1787784504.487501:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.487514:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.487525:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750048256 00000100:00100000:3.0:1787784504.487529:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750048256 00000100:00100000:3.0:1787784504.487547:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787784504.487554:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750048256:12345-0@lo:101: 00010000:00010000:3.0:1787784504.487560:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784504.487568:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c0031400/0x88ace7295d9cc8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cc83 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.487582:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c0031400/0x88ace7295d9cc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cc83 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.487591:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c0031400/0x88ace7295d9cc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cc83 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.487609:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0031400, rc 0) 00000100:00100000:3.0:1787784504.487638:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750048256:12345-0@lo:101: Request processed in 84us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.487643:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787784504.487671:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750048256:0@lo:101: 00010000:00010000:3.0:1787784504.487681:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc8a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.487689:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cc8a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784504.487732:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750048384:0@lo:501: 00000100:00100000:3.0:1787784504.487755:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.487788:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.487800:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750048384 00000100:00100000:3.0:1787784504.487803:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750048384 00000100:00100000:3.0:1787784504.487823:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787784504.487829:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750048384:12345-0@lo:501: 00000100:00100000:3.0:1787784504.487939:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750048384:12345-0@lo:501: Request processed in 110us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.487947:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787784504.487975:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750048384:0@lo:501: 00000100:00100000:3.0:1787784504.488000:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750048512:0@lo:503: 00000100:00100000:3.0:1787784504.488038:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.488051:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.488067:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750048512 00000100:00100000:3.0:1787784504.488070:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750048512 00000100:00100000:3.0:1787784504.488091:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787784504.488097:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750048512:12345-0@lo:503: 00000100:00100000:3.0:1787784504.488168:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750048512:12345-0@lo:503: Request processed in 70us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.488175:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787784504.488212:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750048512:0@lo:503: 00000100:00100000:0.0:1787784504.524512:0:9916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9916:1874627750048640:0@lo:502: 00000100:00100000:0.0:1787784504.524597:0:9916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784504.524645:0:9916:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d2148f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.525635:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750048640 00000100:00100000:3.0:1787784504.525646:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750048640 00000100:00100000:3.0:1787784504.525799:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787784504.525815:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:9916:x1874627750048640:12345-0@lo:502: 00000100:00100000:3.0:1787784504.526104:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:9916:x1874627750048640:12345-0@lo:502: Request processed in 292us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.526116:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787784504.526213:0:9916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9916:1874627750048640:0@lo:502: 00000020:01000000:3.0:1787784504.526259:0:9916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787784504.526268:0:9916:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787784504.526277:0:9916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784504.526280:0:9916:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787784504.526285:0:9916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787784504.526289:0:9916:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:3.0:1787784504.526317:0:9916:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787784504.526321:0:9916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784504.526340:0:9916:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8950c25b3370) 00000020:00000080:3.0:1787784504.528487:0:9916:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1787784504.528537:0:9916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787784504.528662:0:9916:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787784504.528668:0:9916:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787784504.528676:0:9916:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9cc98 00010000:00080000:3.0:1787784504.528713:0:9916:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951f6790800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1787784504.530593:0:9916:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1787784504.530747:0:9916:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787784504.531545:0:9916:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787784504.532677:0:9916:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784504.532970:0:9916:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784504.533120:0:9916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787784504.533207:0:9916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787784504.547616:0:9918:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787784504.547627:0:9918:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787784504.549936:0:9916:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787784504.549960:0:9916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787784504.550008:0:9916:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787784504.550034:0:9916:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9cc9f 00000100:00080000:2.0:1787784504.550045:0:9916:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784504.550051:0:9916:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8951f6790800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784504.550087:0:9916:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c339ed00 x1874627750048768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784504.550115:0:9916:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787784504.550176:0:9916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784504.550181:0:9916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784504.550183:0:9916:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787784504.550186:0:9916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784504.550189:0:9916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784504.550191:0:9916:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784504.550194:0:9916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784504.550195:0:9916:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787784504.550221:0:9916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9916:1874627750049024:0@lo:502: 00000100:00100000:1.0:1787784504.550262:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750048896:0@lo:400: 00000100:00100000:2.0:1787784504.550300:0:9916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784504.550378:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750048768:0@lo:8: 00000100:00100000:3.0:1787784504.550427:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750049024 00000100:00100000:3.0:1787784504.550434:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750049024 00000100:00100000:3.0:1787784504.550470:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787784504.550479:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+20:9916:x1874627750049024:12345-0@lo:502: 00000100:00100000:1.0:1787784504.552392:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.552459:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750049536:0@lo:400: 00000100:00100000:1.0:1787784504.552511:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.552539:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787784504.552545:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750049152:0@lo:400: 00000100:00100000:1.0:1787784504.552570:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.552592:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750049664:0@lo:400: 00000100:00100000:1.0:1787784504.552615:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.552652:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750049408:0@lo:400: 00000100:00100000:1.0:1787784504.552673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.552690:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787784504.552695:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750049280:0@lo:400: 00000100:00100000:1.0:1787784504.552714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.552751:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750049792:0@lo:400: 00000100:00100000:1.0:1787784504.552804:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.553683:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750049152 00000100:00100000:2.0:1787784504.553694:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750049152 00000100:00100000:2.0:1787784504.554934:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787784504.554949:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750049152:12345-0@lo:400: 00000100:00100000:2.0:1787784504.555063:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750049152:12345-0@lo:400: Request processed in 118us (2491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.555071:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787784504.555110:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750048896 00000100:00100000:2.0:1787784504.555117:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750048896 00000100:00100000:2.0:1787784504.555139:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750049536 00000100:00100000:2.0:1787784504.555142:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750049536 00000100:00100000:2.0:1787784504.555169:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750049664 00000100:00100000:2.0:1787784504.555186:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750049664 00000100:00100000:2.0:1787784504.555205:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750049408 00000100:00100000:2.0:1787784504.555208:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750049408 00000100:00100000:2.0:1787784504.555221:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750049280 00000100:00100000:2.0:1787784504.555223:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750049280 00000100:00100000:2.0:1787784504.555235:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750049792 00000100:00100000:2.0:1787784504.555238:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750049792 00000100:00100000:2.0:1787784504.555254:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787784504.555260:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750048896:12345-0@lo:400: 00000100:00100000:2.0:1787784504.555298:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750048896:12345-0@lo:400: Request processed in 38us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.555305:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787784504.555319:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787784504.555326:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3271e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750049536:12345-0@lo:400: 00000100:00100000:2.0:1787784504.555357:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3271e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750049536:12345-0@lo:400: Request processed in 32us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.555363:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787784504.555374:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787784504.555380:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3271a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750049664:12345-0@lo:400: 00000100:00100000:2.0:1787784504.557339:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3271a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750049664:12345-0@lo:400: Request processed in 1952us (4715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784504.557339:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.557350:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787784504.557382:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787784504.557393:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750049408:12345-0@lo:400: 00000100:00080000:0.0:1787784504.557417:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784504.557423:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784504.557535:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750049408:12345-0@lo:400: Request processed in 146us (4860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.557542:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787784504.557555:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787784504.557573:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750049280:12345-0@lo:400: 00000100:00100000:2.0:1787784504.557604:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750049280:12345-0@lo:400: Request processed in 32us (4888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.557609:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787784504.557621:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787784504.557628:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750049792:12345-0@lo:400: 00000100:00100000:2.0:1787784504.557653:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750049792:12345-0@lo:400: Request processed in 26us (4850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.557659:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787784504.558845:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750049152:0@lo:400: 00010000:00080000:2.0:1787784504.558874:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c32721c0 x1874627750049664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784504.558897:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750049664:0@lo:400: 00010000:00080000:2.0:1787784504.558912:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c32712c0 x1874627750048896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784504.558920:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750048896:0@lo:400: 00010000:00080000:2.0:1787784504.558931:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c32730c0 x1874627750049536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784504.558938:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750049536:0@lo:400: 00000100:00100000:2.0:1787784504.558982:0:9916:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784504.559056:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750048768 00000100:00100000:1.0:1787784504.559064:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750048768 00000100:00100000:1.0:1787784504.559112:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787784504.559120:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2608b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1874627750048768:12345-0@lo:8: 00010000:00080000:1.0:1787784504.559151:0:8916:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1787784504.559202:0:8916:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9cca6 00002000:00100000:1.0:1787784504.559218:0:8916:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8951eff1e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787784504.559222:0:8916:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1787784504.559226:0:8916:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787784504.559296:0:8916:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787784504.559556:0:8916:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787784504.559583:0:8916:0:(import.c:65:import_set_state_nolock()) ffff8951eff1a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784504.559662:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2608b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3643:x1874627750048768:12345-0@lo:8: Request processed in 541us (2323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.559669:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787784504.559942:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339ed00 x1874627750048768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784504.559952:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784504.559959:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787784504.559973:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787784504.559978:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787784504.559981:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f6790800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787784504.559991:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787784504.559995:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750048768:0@lo:8: 00010000:00080000:0.0:1787784504.560692:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3273840 x1874627750049280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784504.560705:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750049280:0@lo:400: 00010000:00080000:0.0:1787784504.560724:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3272580 x1874627750049792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784504.560732:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750049792:0@lo:400: 00010000:00080000:0.0:1787784504.560742:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3270f00 x1874627750049408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784504.560760:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750049408:0@lo:400: 00000100:00100000:1.0:1787784504.561190:0:9921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9921:1874627750049920:0@lo:700: 00000100:00100000:1.0:1787784504.561246:0:9921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.561285:0:9921:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa994cc0 going to sleep for 11 seconds 00000004:00080000:1.0:1787784504.561304:0:9918:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787784504.561445:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750049920 00000100:00100000:0.0:1787784504.561452:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750049920 00000100:00100000:0.0:1787784504.561506:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784504.561516:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9921:x1874627750049920:12345-0@lo:700: 00000100:00100000:0.0:1787784504.561550:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26092c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8445:1874627750050048:0@lo:700: 00000100:00100000:0.0:1787784504.561584:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784504.561603:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d2148f00 going to sleep for 11 seconds 00000100:00080000:0.0:1787784504.561615:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784504.561632:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750050048 00000100:00100000:0.0:1787784504.561636:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750050048 00000100:00100000:0.0:1787784504.561663:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784504.561669:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2609e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8445:x1874627750050048:12345-0@lo:700: 00000004:00080000:1.0:1787784504.561897:0:9918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 244811127548ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787784504.561904:0:9918:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1787784504.566497:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787784504.569080:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+20:9916:x1874627750049024:12345-0@lo:502: Request processed in 18591us (18768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.569094:0:9916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9916:1874627750049024:0@lo:502: 00000100:00100000:3.0:1787784504.569098:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000020:01000000:1.0:1787784504.569144:0:9916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784504.569153:0:9916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784504.569156:0:9916:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787784504.569167:0:9916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 40000000:02000000:0.0:1787784504.569233:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000020:01000000:3.0:1787784504.569732:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1787784504.569759:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787784504.569798:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc8a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.569810:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc8a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784504.569821:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787784504.569824:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951d08ed800 from 39 10000000:01000000:3.0:1787784504.569827:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787784504.569860:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.569874:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.569885:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784504.569920:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750050176:0@lo:101: 00000100:00100000:3.0:1787784504.569974:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.570014:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c8bd0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784504.570122:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750050176 00000100:00100000:1.0:1787784504.570128:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750050176 00000100:00100000:1.0:1787784504.570170:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787784504.570177:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750050176:12345-0@lo:101: 00010000:00010000:1.0:1787784504.570188:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784504.570199:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ccb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ccad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.570218:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ccb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ccad expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.570225:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ccb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ccad expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.570232:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34600, rc 0) 00000100:00100000:1.0:1787784504.570264:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750050176:12345-0@lo:101: Request processed in 87us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.570271:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787784504.571525:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750050176:0@lo:101: 00010000:00010000:3.0:1787784504.571549:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ccb4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784504.571560:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ccb4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784504.571645:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750050304:0@lo:501: 00000100:00100000:3.0:1787784504.571692:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.571723:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c8bd0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.571746:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750050304 00000100:00100000:3.0:1787784504.571752:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750050304 00000100:00100000:3.0:1787784504.571830:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787784504.571842:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750050304:12345-0@lo:501: 00000100:00100000:3.0:1787784504.572016:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750050304:12345-0@lo:501: Request processed in 176us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.572026:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787784504.572093:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750050304:0@lo:501: 00000100:00100000:3.0:1787784504.572129:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750050432:0@lo:503: 00000100:00100000:3.0:1787784504.572185:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.572204:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c8bd0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.572222:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750050432 00000100:00100000:3.0:1787784504.572227:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750050432 00000100:00100000:3.0:1787784504.572258:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787784504.572265:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750050432:12345-0@lo:503: 00000100:00100000:3.0:1787784504.573575:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750050432:12345-0@lo:503: Request processed in 1301us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.573590:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787784504.573674:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750050432:0@lo:503: 00000100:00100000:3.0:1787784504.573962:0:9922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9922:1874627750050560:0@lo:502: 00000100:00100000:3.0:1787784504.574008:0:9922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.574036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750050560 00000100:00100000:3.0:1787784504.574040:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750050560 00000100:00100000:3.0:1787784504.574068:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787784504.574075:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:9922:x1874627750050560:12345-0@lo:502: 00000100:00100000:3.0:1787784504.574172:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:9922:x1874627750050560:12345-0@lo:502: Request processed in 97us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.574178:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787784504.574208:0:9922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.574220:0:9922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9922:1874627750050560:0@lo:502: 00000100:00100000:3.0:1787784504.574256:0:9922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9922:1874627750050688:0@lo:502: 00000100:00100000:3.0:1787784504.574284:0:9922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.574307:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750050688 00000100:00100000:3.0:1787784504.574310:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750050688 00000100:00100000:3.0:1787784504.574328:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787784504.574332:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:9922:x1874627750050688:12345-0@lo:502: 00000100:00100000:3.0:1787784504.576513:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:9922:x1874627750050688:12345-0@lo:502: Request processed in 2170us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.576525:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787784504.576584:0:9922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784504.576605:0:9922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9922:1874627750050688:0@lo:502: 00000040:00080000:3.0:1787784504.576638:0:9922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787784504.576815:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787784504.576838:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787784504.576849:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ccb4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.576860:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ccb4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784504.576870:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787784504.576873:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951d08ed800 from 6 10000000:01000000:2.0:1787784504.576876:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787784504.576918:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.576927:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.576937:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784504.576955:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750050816:0@lo:101: 00000100:00100000:2.0:1787784504.576989:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.577014:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784504.577064:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750050816 00000100:00100000:1.0:1787784504.577070:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750050816 00000100:00100000:1.0:1787784504.577120:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787784504.577130:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750050816:12345-0@lo:101: 00010000:00010000:1.0:1787784504.577141:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784504.577153:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d35000/0x88ace7295d9ccc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ccbb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.577175:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d35000/0x88ace7295d9ccc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ccbb expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.577196:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d35000/0x88ace7295d9ccc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ccbb expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.577205:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35000, rc 0) 00000100:00100000:1.0:1787784504.577239:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750050816:12345-0@lo:101: Request processed in 111us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.577245:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787784504.577316:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750050816:0@lo:101: 00010000:00010000:2.0:1787784504.577336:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.577344:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784504.577385:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750050944:0@lo:256: 00000100:00100000:2.0:1787784504.577415:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.577430:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784504.577443:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750050944 00000100:00100000:2.0:1787784504.577447:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750050944 00000100:00100000:2.0:1787784504.577489:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787784504.577497:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750050944:12345-0@lo:256: 20000000:01000000:2.0:1787784504.577511:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787784504.577527:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787784504.577530:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787784504.577723:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750050944:12345-0@lo:256: Request processed in 226us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.577730:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787784504.577852:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750050944:0@lo:256: 10000000:01000000:2.0:1787784504.577908:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787784504.577915:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.577924:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784504.577931:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787784504.577940:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787784504.577943:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787784504.577962:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.577969:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.577976:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784504.577988:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750051072:0@lo:101: 00000100:00100000:2.0:1787784504.578017:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.578036:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784504.578049:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750051072 00000100:00100000:2.0:1787784504.578053:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750051072 00000100:00100000:2.0:1787784504.578078:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787784504.578085:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750051072:12345-0@lo:101: 00010000:00010000:2.0:1787784504.578092:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784504.578102:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5b200/0x88ace7295d9ccd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ccc9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.578118:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5b200/0x88ace7295d9ccd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ccc9 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.578125:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5b200/0x88ace7295d9ccd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ccc9 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.578132:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5b200, rc 0) 00000100:00100000:2.0:1787784504.578163:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750051072:12345-0@lo:101: Request processed in 80us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.578175:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787784504.578208:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750051072:0@lo:101: 00010000:00010000:2.0:1787784504.578219:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ccd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.578226:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ccd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784504.578279:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750051200:0@lo:501: 00000100:00100000:2.0:1787784504.578302:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.578313:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784504.578323:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750051200 00000100:00100000:2.0:1787784504.578327:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750051200 00000100:00100000:2.0:1787784504.578346:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787784504.578352:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750051200:12345-0@lo:501: 00000100:00100000:2.0:1787784504.578469:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750051200:12345-0@lo:501: Request processed in 116us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.578475:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787784504.579053:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750051200:0@lo:501: 00000100:00100000:2.0:1787784504.579083:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750051328:0@lo:503: 00000100:00100000:2.0:1787784504.579128:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.579185:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784504.581636:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750051328 00000100:00100000:1.0:1787784504.581654:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750051328 00000100:00100000:2.0:1787784504.581741:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787784504.581752:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750051328:12345-0@lo:503: 00000100:00100000:2.0:1787784504.582152:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750051328:12345-0@lo:503: Request processed in 399us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.582173:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787784504.582256:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750051328:0@lo:503: 00000100:00100000:3.0:1787784504.587585:0:9924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9924:1874627750051456:0@lo:502: 00000100:00100000:3.0:1787784504.587703:0:9924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.587750:0:9924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784504.589988:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750051456 00000100:00100000:1.0:1787784504.589999:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750051456 00000100:00100000:1.0:1787784504.590052:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787784504.590061:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:9924:x1874627750051456:12345-0@lo:502: 00000100:00100000:1.0:1787784504.590226:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:9924:x1874627750051456:12345-0@lo:502: Request processed in 165us (2523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.590235:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787784504.590302:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2609e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8445:x1874627750050048:12345-0@lo:700: Request processed in 28632us (28715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.590310:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784504.591067:0:9924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9924:1874627750051456:0@lo:502: 00000020:01000000:3.0:1787784504.591104:0:9924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787784504.591112:0:9924:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787784504.591121:0:9924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784504.591123:0:9924:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787784504.591128:0:9924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787784504.591132:0:9924:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:3.0:1787784504.591156:0:9924:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787784504.591159:0:9924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784504.591175:0:9924:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8950c25b4d28) 00000020:00000080:3.0:1787784504.591201:0:9924:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1787784504.591205:0:9924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787784504.591314:0:9924:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787784504.591320:0:9924:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787784504.591327:0:9924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9ccde 00010000:00080000:3.0:1787784504.591374:0:9924:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c34fe000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1787784504.591662:0:9924:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1787784504.591833:0:9924:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787784504.591847:0:9924:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787784504.592050:0:9924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784504.592182:0:9924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784504.592314:0:9924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787784504.592431:0:9924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00010000:00080000:0.0:1787784504.592549:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c26092c0 x1874627750050048/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787784520 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784504.592565:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26092c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8445:1874627750050048:0@lo:700: 40000000:02000000:0.0:1787784504.592577:0:8445:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:1.0:1787784504.594950:0:9925:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787784504.594958:0:9925:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787784504.598628:0:9924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787784504.598645:0:9924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787784504.598693:0:9924:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787784504.598719:0:9924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9cce5 00000100:00080000:2.0:1787784504.598730:0:9924:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784504.598737:0:9924:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8950c34fe000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784504.598795:0:9924:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c339ed00 x1874627750051584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784504.598829:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750051584:0@lo:8: 00000100:00100000:2.0:1787784504.599144:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.599212:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750051584 00000100:00100000:2.0:1787784504.599221:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750051584 00000100:00100000:2.0:1787784504.599253:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787784504.599261:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1874627750051584:12345-0@lo:8: 00010000:00080000:2.0:1787784504.599288:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:2.0:1787784504.599312:0:8437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9ccec 00002000:00100000:2.0:1787784504.599326:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8950c1940000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787784504.599330:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787784504.599333:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787784504.600059:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787784504.600090:0:8437:0:(import.c:65:import_set_state_nolock()) ffff8951ff43e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784504.600157:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1874627750051584:12345-0@lo:8: Request processed in 894us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.600177:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787784504.600233:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339ed00 x1874627750051584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784504.600244:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784504.600253:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787784504.600262:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787784504.600267:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787784504.600271:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c34fe000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787784504.601615:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787784504.601628:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750051584:0@lo:8: 00000100:00080000:2.0:1787784504.601660:0:9924:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000004:00080000:1.0:1787784504.605980:0:9925:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787784504.606098:0:9925:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 244855329080ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787784504.606107:0:9925:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:2.0:1787784504.612534:0:9924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784504.612543:0:9924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784504.612546:0:9924:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787784504.612549:0:9924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784504.612553:0:9924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784504.612554:0:9924:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784504.612557:0:9924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784504.612559:0:9924:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787784504.612603:0:9924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9924:1874627750051712:0@lo:502: 00000100:00100000:2.0:1787784504.612686:0:9924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.612729:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750051712 00000100:00100000:2.0:1787784504.612736:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750051712 00000100:00100000:2.0:1787784504.612799:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787784504.612808:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:9924:x1874627750051712:12345-0@lo:502: 00000100:00100000:2.0:1787784504.612933:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:9924:x1874627750051712:12345-0@lo:502: Request processed in 125us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.612949:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787784504.612995:0:9924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784504.613016:0:9924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:9924:1874627750051712:0@lo:502: 00000020:01000000:2.0:1787784504.613040:0:9924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784504.613044:0:9924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784504.613045:0:9924:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787784504.613049:0:9924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1787784504.615980:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1787784504.616024:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787784504.616036:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ccd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.616049:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ccd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784504.616062:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787784504.616065:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8951cfef0000 from 1 10000000:01000000:1.0:1787784504.616068:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787784504.616109:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.616117:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.616129:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784504.616154:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750051840:0@lo:101: 00000100:00100000:1.0:1787784504.616221:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.616264:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d2179900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784504.616288:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750051840 00000100:00100000:1.0:1787784504.616296:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750051840 00000100:00100000:1.0:1787784504.616348:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787784504.616358:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750051840:12345-0@lo:101: 00010000:00010000:1.0:1787784504.616381:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784504.616394:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ccfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ccf3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.616418:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ccfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ccf3 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.616429:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ccfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ccf3 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.616437:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34200, rc 0) 00000100:00100000:1.0:1787784504.616476:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750051840:12345-0@lo:101: Request processed in 120us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.616483:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787784504.616523:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750051840:0@lo:101: 00010000:00010000:1.0:1787784504.616536:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ccfa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784504.616545:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ccfa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784504.616593:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750051968:0@lo:501: 00000100:00100000:1.0:1787784504.616619:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.616632:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d2179900 going to sleep for 11 seconds 00000001:00100000:0.0:1787784504.616906:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787784504.616913:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000004:00080000:2.0:1787784504.617117:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787784504.617153:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750051968 00000100:00100000:2.0:1787784504.617158:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750051968 00000100:00100000:2.0:1787784504.617188:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787784504.617196:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750051968:12345-0@lo:501: 00000100:00100000:2.0:1787784504.617282:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750051968:12345-0@lo:501: Request processed in 87us (662us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787784504.617290:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787784504.617321:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750051968:0@lo:501: 00000100:00100000:1.0:1787784504.618101:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9921:x1874627750049920:12345-0@lo:700: Request processed in 56584us (56852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.618110:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787784504.618282:0:9921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3270f00 x1874627750049920/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787784520 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784504.618298:0:9921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9921:1874627750049920:0@lo:700: 10000000:01000000:2.0:1787784504.618923:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787784504.618936:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ccfa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784504.618948:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ccfa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787784504.619025:0:9926:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787784504.619050:0:9926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9926:1874627750052224:0@lo:7: 00000100:00100000:2.0:1787784504.619102:0:9926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784504.619151:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750052224 00000100:00100000:2.0:1787784504.619157:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750052224 00000100:00100000:2.0:1787784504.619209:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784504.619219:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9926:x1874627750052224:12345-0@lo:7: 00000100:00100000:1.0:1787784504.619685:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784504.619705:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750052096:0@lo:13: 00000100:00100000:1.0:1787784504.619745:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.619901:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750052096 00000100:00100000:1.0:1787784504.619906:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750052096 00000100:00100000:1.0:1787784504.619938:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784504.619946:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750052096:12345-0@lo:13: 00002000:00000024:1.0:1787784504.619966:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1787784504.620008:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750052096:12345-0@lo:13: Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.620015:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787784504.620050:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339ed00 x1874627750052096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784504.620069:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750052096:0@lo:13: 00000100:00080000:1.0:1787784504.620872:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787784504.627319:0:9921:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787784504.627353:0:9921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2608000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9921:1874627750052480:0@lo:7: 00000100:00100000:0.0:1787784504.627423:0:9921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784504.627467:0:9921:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d2148f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784504.627553:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784504.627570:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750052352:0@lo:13: 00000100:00100000:1.0:1787784504.627606:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.628261:0:9926:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784504.631974:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750052352 00000100:00100000:1.0:1787784504.631988:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750052352 00000100:00100000:1.0:1787784504.632042:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787784504.632054:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750052352:12345-0@lo:13: 00002000:00000024:1.0:1787784504.632082:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1787784504.632169:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750052352:12345-0@lo:13: Request processed in 118us (4562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.632176:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787784504.632221:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c26092c0 x1874627750052352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784504.632255:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750052352:0@lo:13: 00002000:00080000:2.0:1787784504.633754:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787784504.633763:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787784504.633856:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9926:x1874627750052224:12345-0@lo:7: Request processed in 14635us (14751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.633868:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784504.633906:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750052480 00000100:00100000:2.0:1787784504.633913:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750052480 00000100:00100000:2.0:1787784504.633949:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784504.633958:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9921:x1874627750052480:12345-0@lo:7: 00010000:00080000:3.0:1787784504.634382:0:9926:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339f480 x1874627750052224/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787784520 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784504.634397:0:9926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9926:1874627750052224:0@lo:7: 00000004:00080000:3.0:1787784504.634409:0:9926:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787784504.634443:0:9926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9926:1874627750052608:0@lo:5: 00000100:00100000:3.0:1787784504.634481:0:9926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.634806:0:9926:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247840 going to sleep for 11 seconds 00000100:00100000:0.0:1787784504.635085:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750052608 00000100:00100000:0.0:1787784504.635091:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750052608 00000100:00100000:0.0:1787784504.635119:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784504.635127:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9926:x1874627750052608:12345-0@lo:5: 00002000:00080000:0.0:1787784504.635149:0:8916:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787784504.635153:0:8916:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:2.0:1787784504.646342:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787784504.646350:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787784504.646445:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9921:x1874627750052480:12345-0@lo:7: Request processed in 12484us (19018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.646456:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787784504.646502:0:9921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2608000 x1874627750052480/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787784520 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784504.646518:0:9921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2608000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9921:1874627750052480:0@lo:7: 00000004:00080000:1.0:1787784504.646537:0:9921:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787784504.646572:0:9921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32721c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9921:1874627750052736:0@lo:5: 00000100:00100000:1.0:1787784504.646615:0:9921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.646659:0:9921:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c64673c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784504.646985:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9926:x1874627750052608:12345-0@lo:5: Request processed in 11856us (12501us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787784504.646993:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787784504.647000:0:9926:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f5317840 x1874627750052608/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784520 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784504.647009:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750052736 00000100:00100000:1.0:1787784504.647013:0:9926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9926:1874627750052608:0@lo:5: 00000100:00100000:0.0:1787784504.647016:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750052736 00000004:00080000:1.0:1787784504.647024:0:9926:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787784504.647051:0:9926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9926:1874627750052864:0@lo:700: 00000100:00100000:0.0:1787784504.647058:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784504.647067:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3273c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9921:x1874627750052736:12345-0@lo:5: 00000100:00100000:1.0:1787784504.647079:0:9926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1787784504.647092:0:8916:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787784504.647098:0:9926:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c64679c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784504.647141:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3273c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9921:x1874627750052736:12345-0@lo:5: Request processed in 75us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784504.647147:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784504.647168:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750052864 00000100:00100000:0.0:1787784504.647172:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750052864 00000100:00100000:0.0:1787784504.647194:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784504.647201:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3273840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9926:x1874627750052864:12345-0@lo:700: 00010000:00080000:1.0:1787784504.647278:0:9921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c32721c0 x1874627750052736/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784520 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784504.647288:0:9921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32721c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9921:1874627750052736:0@lo:5: 00000004:00080000:1.0:1787784504.647295:0:9921:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787784504.647315:0:9921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32721c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9921:1874627750052992:0@lo:5: 00000100:00100000:1.0:1787784504.647352:0:9921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.647370:0:9921:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c64673c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784504.655791:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750052992 00000100:00100000:2.0:1787784504.656153:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750052992 00000100:00100000:2.0:1787784504.656216:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784504.656226:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9921:x1874627750052992:12345-0@lo:5: 00002000:00080000:2.0:1787784504.656271:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1787784504.659257:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9921:x1874627750052992:12345-0@lo:5: Request processed in 3026us (11898us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787784504.659271:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787784504.659369:0:9921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c32721c0 x1874627750052992/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784520 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784504.659390:0:9921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32721c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9921:1874627750052992:0@lo:5: 00000004:00080000:1.0:1787784504.659406:0:9921:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787784504.659449:0:9921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9921:1874627750053120:0@lo:900: 00000100:00100000:1.0:1787784504.659485:0:9921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.659518:0:9921:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c64673c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784504.660195:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750053120 00000100:00100000:2.0:1787784504.660202:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750053120 00000100:00100000:2.0:1787784504.660251:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784504.660267:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2663840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9921:x1874627750053120:12345-0@lo:900: 00000100:00100000:2.0:1787784504.660337:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2663840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9921:x1874627750053120:12345-0@lo:900: Request processed in 71us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784504.660344:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787784504.660410:0:9921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2660f00 x1874627750053120/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787784520 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784504.660421:0:9921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9921:1874627750053120:0@lo:900: 00000001:00080000:3.0:1787784504.660791:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1787784504.662115:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3273840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9926:x1874627750052864:12345-0@lo:700: Request processed in 14908us (15030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784504.662129:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787784504.662379:0:9926:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3270f00 x1874627750052864/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787784520 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784504.662391:0:9926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787784504.662406:0:9926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9926:1874627750052864:0@lo:700: 00000004:02000040:1.0:1787784504.667485:0:9926:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1787784504.671441:0:9926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2661680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9926:1874627750053248:0@lo:5: 00000100:00100000:1.0:1787784504.672100:0:9926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784504.672150:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750053248 00000100:00100000:1.0:1787784504.672157:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750053248 00000100:00100000:1.0:1787784504.672209:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784504.672219:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2662940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9926:x1874627750053248:12345-0@lo:5: 00000100:00100000:0.0:1787784504.677240:0:9926:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c6467f00 going to sleep for 11 seconds 00002000:00080000:1.0:1787784504.678992:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787784504.679012:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1787784504.681462:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2662940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9926:x1874627750053248:12345-0@lo:5: Request processed in 9239us (9357us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787784504.681478:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787784504.681498:0:9926:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2661680 x1874627750053248/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784520 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784504.681517:0:9926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2661680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9926:1874627750053248:0@lo:5: 00000004:00080000:3.0:1787784504.681534:0:9926:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:2.0:1787784504.701648:0:9938:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784504.702148:0:9938:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787784504.838259:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787784505.633665:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1787784505.633685:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787784505.863280:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784506.502120:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750053376:0@lo:41: 00000100:00100000:1.0:1787784506.502227:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784506.503123:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750053376 00000100:00100000:2.0:1787784506.503140:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750053376 00000100:00100000:2.0:1787784506.503213:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787784506.503224:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2663c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750053376:12345-0@lo:41: 00000004:00000024:2.0:1787784506.503263:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787784506.509309:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2663c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750053376:12345-0@lo:41: Request processed in 6077us (7072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784506.509325:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787784506.513027:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750053376:0@lo:41: 00010000:00010000:1.0:1787784506.886013:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787784507.814732:0:10040:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787784507.815383:0:10040:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787784507.912020:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787784508.864643:0:10088:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784508.864661:0:10088:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1787784508.934001:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784509.420414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784509.420481:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727982720 00000100:00100000:1.0:1787784509.420503:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727982720 00000100:00100000:1.0:1787784509.420563:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 182 00000100:00100000:1.0:1787784509.420575:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2404:x1874627727982720:12345-192.168.202.41@tcp:250: 00010000:00080000:1.0:1787784509.420615:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 65cfdd26-2f8c-42a9-9063-79ee47420602@192.168.202.41@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:1.0:1787784509.420653:0:6516:0:(genops.c:1385:class_connect()) connect: client 65cfdd26-2f8c-42a9-9063-79ee47420602, cookie 0x88ace7295d9cd01 00000100:00080000:1.0:1787784509.421250:0:6516:0:(import.c:65:import_set_state_nolock()) ffff8951d87af000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784509.421348:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+5:2404:x1874627727982720:12345-192.168.202.41@tcp:250: Request processed in 772us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784509.421359:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 182 00000100:00100000:3.0:1787784509.432582:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784509.432707:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727982848 00000100:00100000:1.0:1787784509.432720:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727982848 00000100:00100000:1.0:1787784509.432871:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 183 00000100:00100000:1.0:1787784509.432885:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+5:6167:x1874627727982848:12345-192.168.202.41@tcp:101: 00010000:00010000:1.0:1787784509.432908:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784509.432932:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72855 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784509.433245:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72855 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784509.433260:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72855 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784509.433272:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35200, rc 0) 00000100:00100000:1.0:1787784509.433351:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+6:6167:x1874627727982848:12345-192.168.202.41@tcp:101: Request processed in 469us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784509.433372:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 183 00000100:00100000:3.0:1787784509.441448:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784509.441623:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727982976 00000100:00100000:1.0:1787784509.441637:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727982976 00000100:00100000:1.0:1787784509.441708:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:1.0:1787784509.441720:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+6:6167:x1874627727982976:12345-192.168.202.41@tcp:501: 00000100:00100000:1.0:1787784509.441939:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+6:6167:x1874627727982976:12345-192.168.202.41@tcp:501: Request processed in 220us (506us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787784509.441949:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:2.0:1787784509.446343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784509.447353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727983104 00000100:00100000:3.0:1787784509.447389:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727983104 00000100:00100000:2.0:1787784509.447595:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:2.0:1787784509.447609:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+6:6167:x1874627727983104:12345-192.168.202.41@tcp:101: 00010000:00010000:2.0:1787784509.447632:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784509.447655:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5b600/0x88ace7295d9cd0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7285c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784509.447696:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5b600/0x88ace7295d9cd0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7285c expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784509.452112:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5b600/0x88ace7295d9cd0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7285c expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784509.452127:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5b600, rc 0) 00000100:00100000:2.0:1787784509.452326:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+7:6167:x1874627727983104:12345-192.168.202.41@tcp:101: Request processed in 4717us (5998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784509.452338:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:0.0:1787784509.460248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784509.462834:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727983232 00000100:00100000:1.0:1787784509.462866:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727983232 00000100:00100000:1.0:1787784509.462970:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 186 00000100:00100000:1.0:1787784509.462982:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+7:6167:x1874627727983232:12345-192.168.202.41@tcp:501: 00000100:00100000:1.0:1787784509.463210:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+8:6167:x1874627727983232:12345-192.168.202.41@tcp:501: Request processed in 229us (2982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784509.463220:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 186 00000100:00100000:2.0:1787784509.470950:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784509.474284:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727983360 00000100:00100000:0.0:1787784509.474307:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727983360 00000100:00100000:0.0:1787784509.474418:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00100000:0.0:1787784509.474430:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+8:6167:x1874627727983360:12345-192.168.202.41@tcp:503: 00000100:00100000:0.0:1787784509.474658:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+8:6167:x1874627727983360:12345-192.168.202.41@tcp:503: Request processed in 229us (3722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784509.474667:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00100000:2.0:1787784509.495253:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784509.498094:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727983488 00000100:00100000:1.0:1787784509.498115:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727983488 00000100:00100000:1.0:1787784509.498219:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 188 00000100:00100000:1.0:1787784509.498233:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+8:6186:x1874627727983488:12345-192.168.202.41@tcp:502: 00000100:00100000:1.0:1787784509.498492:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+8:6186:x1874627727983488:12345-192.168.202.41@tcp:502: Request processed in 261us (3255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784509.498501:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 188 00000100:00100000:1.0:1787784509.539543:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784509.539705:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727983616 00000100:00100000:0.0:1787784509.539730:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727983616 00000100:00100000:0.0:1787784509.539871:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:0.0:1787784509.539885:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+8:6186:x1874627727983616:12345-192.168.202.41@tcp:502: 00000100:00100000:0.0:1787784509.540114:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+8:6186:x1874627727983616:12345-192.168.202.41@tcp:502: Request processed in 232us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784509.540123:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:3.0:1787784509.545510:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784509.545828:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727983744 00000100:00100000:1.0:1787784509.545854:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727983744 00000100:00100000:1.0:1787784509.545938:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 190 00000100:00100000:1.0:1787784509.545950:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+8:6167:x1874627727983744:12345-192.168.202.41@tcp:101: 00010000:00010000:1.0:1787784509.545974:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784509.545999:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9cd16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7288d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784509.546041:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9cd16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7288d expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784509.546054:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9cd16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7288d expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784509.546067:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34a00, rc 0) 00000100:00100000:1.0:1787784509.546155:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6167:x1874627727983744:12345-192.168.202.41@tcp:101: Request processed in 207us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784509.546163:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 190 00000100:00100000:2.0:1787784509.548746:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784509.548828:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727983872 00000100:00100000:3.0:1787784509.548850:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727983872 00000100:00100000:3.0:1787784509.548914:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:3.0:1787784509.548926:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6167:x1874627727983872:12345-192.168.202.41@tcp:256: 20000000:01000000:3.0:1787784509.548960:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787784509.548995:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787784509.549000:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787784509.549003:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787784509.549007:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787784509.549010:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787784509.555250:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6167:x1874627727983872:12345-192.168.202.41@tcp:256: Request processed in 6307us (6501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784509.555282:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:2.0:1787784509.571473:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784509.571581:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727984000 00000100:00100000:0.0:1787784509.571594:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727984000 00000100:00100000:0.0:1787784509.571669:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:0.0:1787784509.571680:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfeea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6167:x1874627727984000:12345-192.168.202.41@tcp:101: 00010000:00010000:0.0:1787784509.571704:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784509.571735:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1629400/0x88ace7295d9cd1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72894 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784509.571808:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629400/0x88ace7295d9cd1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72894 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784509.571821:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1629400/0x88ace7295d9cd1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72894 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784509.571859:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629400, rc 0) 00000100:00100000:0.0:1787784509.571928:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfeea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6167:x1874627727984000:12345-192.168.202.41@tcp:101: Request processed in 250us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784509.571936:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:1.0:1787784509.574089:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750053504:0@lo:13: 00000100:00100000:1.0:1787784509.574186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784509.574404:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750053504 00000100:00100000:2.0:1787784509.574415:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750053504 00000100:00100000:2.0:1787784509.574519:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784509.574532:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2661e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750053504:12345-0@lo:13: 00002000:00000024:2.0:1787784509.574571:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784509.574630:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2661e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750053504:12345-0@lo:13: Request processed in 101us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784509.574638:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787784509.574705:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787784509.574923:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f5317840 x1874627750053504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784509.574946:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750053504:0@lo:13: 00000100:00100000:1.0:1787784509.574979:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784509.574987:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750053632:0@lo:41: 00000100:00100000:1.0:1787784509.575025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784509.575368:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2661a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750053760:0@lo:13: 00000100:00100000:3.0:1787784509.575404:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784509.575485:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750053760 00000100:00100000:1.0:1787784509.575492:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750053760 00000100:00100000:1.0:1787784509.575555:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784509.575563:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750053760:12345-0@lo:13: 00002000:00000024:1.0:1787784509.575601:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784509.575639:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750053760:12345-0@lo:13: Request processed in 77us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784509.575646:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787784509.575710:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787784509.575744:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2661a40 x1874627750053760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784509.575759:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2661a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750053760:0@lo:13: 00000100:00100000:2.0:1787784509.576181:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750053632 00000100:00100000:2.0:1787784509.576187:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750053632 00000100:00100000:2.0:1787784509.576236:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787784509.576246:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2662d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750053632:12345-0@lo:41: 00000004:00000024:2.0:1787784509.576293:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787784509.576356:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2662d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750053632:12345-0@lo:41: Request processed in 112us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784509.576363:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787784509.576448:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750053632:0@lo:41: 00000100:00100000:0.0:1787784509.586520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784509.586671:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727984128 00000100:00100000:2.0:1787784509.586684:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727984128 00000100:00100000:2.0:1787784509.586802:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00100000:2.0:1787784509.586816:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfeeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6167:x1874627727984128:12345-192.168.202.41@tcp:501: 00000100:00100000:2.0:1787784509.587064:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfeeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6167:x1874627727984128:12345-192.168.202.41@tcp:501: Request processed in 251us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784509.587074:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00100000:3.0:1787784509.589340:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784509.589467:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727984256 00000100:00100000:1.0:1787784509.589479:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727984256 00000100:00100000:1.0:1787784509.589558:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:1.0:1787784509.589569:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6167:x1874627727984256:12345-192.168.202.41@tcp:503: 00000100:00100000:1.0:1787784509.589824:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6167:x1874627727984256:12345-192.168.202.41@tcp:503: Request processed in 255us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784509.589834:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:3.0:1787784509.592582:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784509.592722:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727984384 00000100:00100000:0.0:1787784509.592737:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727984384 00000100:00100000:0.0:1787784509.592850:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 195 00000100:00100000:0.0:1787784509.592862:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6192:x1874627727984384:12345-192.168.202.41@tcp:502: 00000100:00100000:0.0:1787784509.593080:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6192:x1874627727984384:12345-192.168.202.41@tcp:502: Request processed in 218us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784509.593090:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 195 00000100:00100000:0.0:1787784509.596157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784509.596403:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727984512 00000100:00100000:2.0:1787784509.596418:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727984512 00000100:00100000:2.0:1787784509.596529:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 196 00000100:00100000:2.0:1787784509.596541:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6192:x1874627727984512:12345-192.168.202.41@tcp:502: 00000100:00100000:2.0:1787784509.596794:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6192:x1874627727984512:12345-192.168.202.41@tcp:502: Request processed in 227us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784509.596804:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 196 00000100:00100000:3.0:1787784509.604249:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784509.604321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784509.604431:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727984640 00000100:00100000:1.0:1787784509.604445:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727984640 00000100:00100000:1.0:1787784509.604510:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727984896 00000100:00100000:1.0:1787784509.604514:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727984896 00000100:00100000:1.0:1787784509.604548:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1787784509.604559:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5317840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2404:x1874627727984640:12345-192.168.202.41@tcp:38: 00010000:00080000:1.0:1787784509.604602:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:1.0:1787784509.604690:0:6523:0:(genops.c:1385:class_connect()) connect: client 2e90d38f-8956-47bc-80da-c902c22ae09c, cookie 0x88ace7295d9cd24 00000004:00100000:1.0:1787784509.604738:0:6523:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787784509.605138:0:6523:0:(import.c:65:import_set_state_nolock()) ffff8951f53b5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784509.605227:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5317840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2404:x1874627727984640:12345-192.168.202.41@tcp:38: Request processed in 668us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784509.605238:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1787784509.605261:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:1.0:1787784509.605274:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2404:x1874627727984896:12345-192.168.202.41@tcp:38: 00010000:00080000:1.0:1787784509.605291:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:1.0:1787784509.605329:0:6523:0:(genops.c:1385:class_connect()) connect: client 2e90d38f-8956-47bc-80da-c902c22ae09c, cookie 0x88ace7295d9cd2b 00000004:00100000:1.0:1787784509.605343:0:6523:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787784509.605481:0:6523:0:(import.c:65:import_set_state_nolock()) ffff895201ca3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784509.605505:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2404:x1874627727984896:12345-192.168.202.41@tcp:38: Request processed in 231us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784509.605512:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00010000:00010000:3.0:1787784509.958416:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784510.087337:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750054144:0@lo:400: 00000100:00100000:0.0:1787784510.087435:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784510.087510:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750054656:0@lo:400: 00000100:00100000:0.0:1787784510.087544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784510.087570:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750055168:0@lo:400: 00000100:00100000:0.0:1787784510.087594:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784510.087622:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787784510.087628:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750054016:0@lo:400: 00000100:00100000:0.0:1787784510.087649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784510.087666:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750054528:0@lo:400: 00000100:00100000:0.0:1787784510.087686:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784510.087717:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750055040:0@lo:400: 00000100:00100000:0.0:1787784510.087740:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784510.087808:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750054656 00000100:00100000:0.0:1787784510.087817:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750054656 00000100:00100000:0.0:1787784510.087898:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750055168 00000100:00100000:0.0:1787784510.087902:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750055168 00000100:00100000:0.0:1787784510.087920:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750054016 00000100:00100000:0.0:1787784510.087923:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750054016 00000100:00100000:0.0:1787784510.087934:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750054528 00000100:00100000:0.0:1787784510.087937:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750054528 00000100:00100000:0.0:1787784510.087956:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750055040 00000100:00100000:0.0:1787784510.087959:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750055040 00000100:00100000:0.0:1787784510.087976:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787784510.087986:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750054656:12345-0@lo:400: 00000100:00100000:0.0:1787784510.088048:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750054656:12345-0@lo:400: Request processed in 63us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784510.088055:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787784510.088074:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787784510.088080:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750055168:12345-0@lo:400: 00000100:00100000:0.0:1787784510.088107:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750055168:12345-0@lo:400: Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784510.088113:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787784510.088123:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787784510.088128:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750054016:12345-0@lo:400: 00000100:00100000:0.0:1787784510.088153:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750054016:12345-0@lo:400: Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784510.088159:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787784510.088170:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787784510.088183:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750054528:12345-0@lo:400: 00000100:00100000:0.0:1787784510.088212:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750054528:12345-0@lo:400: Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784510.088218:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787784510.088229:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787784510.088236:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750055040:12345-0@lo:400: 00000100:00100000:0.0:1787784510.088264:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750055040:12345-0@lo:400: Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784510.088270:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787784510.088297:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784510.088302:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787784510.088338:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c26083c0 x1874627750054016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784510.088355:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750054016:0@lo:400: 00010000:00080000:0.0:1787784510.088366:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2608000 x1874627750054528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784510.088373:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750054528:0@lo:400: 00010000:00080000:0.0:1787784510.088382:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53cb0c0 x1874627750055040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784510.088389:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750055040:0@lo:400: 00010000:00080000:0.0:1787784510.088398:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c26092c0 x1874627750054656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784510.088405:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750054656:0@lo:400: 00010000:00080000:0.0:1787784510.088413:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951cffcb840 x1874627750055168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784510.088427:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750055168:0@lo:400: 00000100:00100000:3.0:1787784510.088683:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750054272:0@lo:400: 00000100:00100000:3.0:1787784510.088724:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784510.088753:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750054784:0@lo:400: 00000100:00100000:3.0:1787784510.088815:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784510.088845:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750055296:0@lo:400: 00000100:00100000:3.0:1787784510.088906:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784510.088938:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787784510.088956:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750053888:0@lo:400: 00000100:00100000:3.0:1787784510.088988:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784510.089009:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750054400:0@lo:400: 00000100:00100000:3.0:1787784510.089035:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784510.089056:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750054912:0@lo:400: 00000100:00100000:3.0:1787784510.089092:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784510.089108:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750055424:0@lo:400: 00000100:00100000:3.0:1787784510.089130:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784510.089337:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750054144 00000100:00100000:3.0:1787784510.089345:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750054144 00000100:00100000:3.0:1787784510.089374:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750054400 00000100:00100000:3.0:1787784510.089377:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750054400 00000100:00100000:3.0:1787784510.089392:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787784510.089399:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750054144:12345-0@lo:400: 00000100:00100000:3.0:1787784510.089448:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750054144:12345-0@lo:400: Request processed in 49us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784510.089455:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787784510.089468:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787784510.089474:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750054400:12345-0@lo:400: 00000100:00100000:3.0:1787784510.089501:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750054400:12345-0@lo:400: Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784510.089508:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787784510.089545:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750054144:0@lo:400: 00000100:00100000:3.0:1787784510.089568:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750054400:0@lo:400: 00000100:00100000:2.0:1787784510.089660:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750054784 00000100:00100000:2.0:1787784510.089664:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750054784 00000100:00100000:2.0:1787784510.089687:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750055296 00000100:00100000:2.0:1787784510.089690:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750055296 00000100:00100000:2.0:1787784510.089717:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750054912 00000100:00100000:2.0:1787784510.089720:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750054912 00000100:00100000:2.0:1787784510.089730:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750055424 00000100:00100000:2.0:1787784510.089731:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750055424 00000100:00100000:2.0:1787784510.089744:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784510.089751:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750054784:12345-0@lo:400: 00000100:00100000:2.0:1787784510.089829:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750054784:12345-0@lo:400: Request processed in 78us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784510.089846:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784510.089860:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784510.089867:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750055296:12345-0@lo:400: 00000100:00100000:2.0:1787784510.089907:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750055296:12345-0@lo:400: Request processed in 40us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784510.089913:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784510.089924:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784510.089930:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750054912:12345-0@lo:400: 00000100:00100000:2.0:1787784510.089968:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750054912:12345-0@lo:400: Request processed in 38us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784510.089974:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784510.089986:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784510.089992:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750055424:12345-0@lo:400: 00000100:00100000:2.0:1787784510.090018:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750055424:12345-0@lo:400: Request processed in 27us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784510.090024:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787784510.090063:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53c92c0 x1874627750054912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784510.090074:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750054912:0@lo:400: 00010000:00080000:2.0:1787784510.090083:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951cffca940 x1874627750055424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784510.090090:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787784510.090102:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750055424:0@lo:400: 00010000:00080000:2.0:1787784510.090121:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53c8b40 x1874627750054784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784510.090129:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750054784:0@lo:400: 00010000:00080000:2.0:1787784510.090138:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951cffc9680 x1874627750055296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784510.090146:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787784510.090155:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750055296:0@lo:400: 00000100:00080000:3.0:1787784510.090421:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784510.090614:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750054272 00000100:00100000:0.0:1787784510.090620:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750054272 00000100:00100000:0.0:1787784510.090670:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787784510.090678:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3271680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750054272:12345-0@lo:400: 00000100:00100000:0.0:1787784510.090738:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3271680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750054272:12345-0@lo:400: Request processed in 61us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784510.090745:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787784510.091193:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750053888 00000100:00100000:1.0:1787784510.091199:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750053888 00000100:00100000:1.0:1787784510.091237:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787784510.091245:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750053888:12345-0@lo:400: 00000100:00100000:1.0:1787784510.091284:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750053888:12345-0@lo:400: Request processed in 41us (2295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784510.091291:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787784510.091629:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750055680:0@lo:13: 00000100:00100000:3.0:1787784510.091669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784510.091705:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784510.091711:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750055552:0@lo:13: 00000100:00100000:3.0:1787784510.091732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784510.091800:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750053888:0@lo:400: 00010000:00080000:3.0:1787784510.091820:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c260bc00 x1874627750054272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784510.091833:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750054272:0@lo:400: 00000100:00100000:1.0:1787784510.092113:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750055680 00000100:00100000:1.0:1787784510.092119:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750055680 00000100:00100000:1.0:1787784510.092143:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750055552 00000100:00100000:1.0:1787784510.092146:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750055552 00000100:00100000:1.0:1787784510.092160:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784510.092167:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750055680:12345-0@lo:13: 00002000:00000024:1.0:1787784510.092196:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784510.092241:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750055680:12345-0@lo:13: Request processed in 74us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784510.092248:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784510.092261:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784510.092267:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750055552:12345-0@lo:13: 00002000:00000024:1.0:1787784510.092291:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784510.092313:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750055552:12345-0@lo:13: Request processed in 47us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784510.092319:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787784510.092442:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951cffcb840 x1874627750055552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784510.092457:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750055552:0@lo:13: 00010000:00080000:3.0:1787784510.092470:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f534f480 x1874627750055680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784510.092479:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750055680:0@lo:13: 00000100:00100000:3.0:1787784510.620651:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784510.620704:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784510.620824:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727984768 00000100:00100000:0.0:1787784510.620852:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727984768 00000100:00100000:0.0:1787784510.620951:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727985152 00000100:00100000:0.0:1787784510.620955:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727985152 00000100:00100000:0.0:1787784510.620979:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:0.0:1787784510.620990:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:0:x1874627727984768:12345-192.168.202.41@tcp:41: 00000004:00000024:0.0:1787784510.621044:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787784510.621128:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:0:x1874627727984768:12345-192.168.202.41@tcp:41: Request processed in 141us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784510.621138:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:0.0:1787784510.621162:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:0.0:1787784510.621168:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6167:x1874627727985152:12345-192.168.202.41@tcp:41: 00000004:00000024:0.0:1787784510.621180:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787784510.621201:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6167:x1874627727985152:12345-192.168.202.41@tcp:41: Request processed in 33us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784510.621206:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00080000:3.0:1787784510.621537:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784510.624697:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784510.624854:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784510.632600:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727985280 00000100:00100000:3.0:1787784510.632627:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727985280 00000100:00100000:3.0:1787784510.632748:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727985024 00000100:00100000:3.0:1787784510.632752:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727985024 00000100:00100000:3.0:1787784510.632868:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:3.0:1787784510.632882:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6167:x1874627727985280:12345-192.168.202.41@tcp:40: 00000100:00100000:3.0:1787784510.633112:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6167:x1874627727985280:12345-192.168.202.41@tcp:40: Request processed in 232us (8431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784510.633121:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:3.0:1787784510.633144:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:3.0:1787784510.633316:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:0:x1874627727985024:12345-192.168.202.41@tcp:41: 00000004:00000024:3.0:1787784510.633343:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787784510.633380:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:0:x1874627727985024:12345-192.168.202.41@tcp:41: Request processed in 230us (8526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784510.633387:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00080000:3.0:1787784510.633420:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784510.643147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784510.643189:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784510.643227:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784510.643411:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727985408 00000100:00100000:0.0:1787784510.643423:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727985408 00000100:00100000:0.0:1787784510.643470:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727985536 00000100:00100000:0.0:1787784510.643472:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727985536 00000100:00100000:0.0:1787784510.643499:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1787784510.643510:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2404:x1874627727985408:12345-192.168.202.41@tcp:8: 00010000:00080000:0.0:1787784510.643555:0:8916:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:0.0:1787784510.643596:0:8916:0:(genops.c:1385:class_connect()) connect: client 2e90d38f-8956-47bc-80da-c902c22ae09c, cookie 0x88ace7295d9cd32 00002000:00100000:0.0:1787784510.643610:0:8916:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e90d38f-8956-47bc-80da-c902c22ae09c/ffff8950c26ea800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784510.643623:0:8916:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787784510.643961:0:8916:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787784510.643999:0:8916:0:(import.c:65:import_set_state_nolock()) ffff8950c26ec800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784510.644085:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2404:x1874627727985408:12345-192.168.202.41@tcp:8: Request processed in 574us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784510.644094:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1787784510.644117:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:0.0:1787784510.644122:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2404:x1874627727985536:12345-192.168.202.41@tcp:8: 00010000:00080000:0.0:1787784510.644140:0:8916:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:0.0:1787784510.644160:0:8916:0:(genops.c:1385:class_connect()) connect: client 2e90d38f-8956-47bc-80da-c902c22ae09c, cookie 0x88ace7295d9cd39 00002000:00100000:0.0:1787784510.644166:0:8916:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2e90d38f-8956-47bc-80da-c902c22ae09c/ffff8950c26e9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784510.644173:0:8916:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787784510.644307:0:8916:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787784510.644325:0:8916:0:(import.c:65:import_set_state_nolock()) ffff8950c26ed000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784510.644349:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2404:x1874627727985536:12345-192.168.202.41@tcp:8: Request processed in 226us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784510.644363:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:2.0:1787784510.645450:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727985664 00000100:00100000:2.0:1787784510.645461:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727985664 00000100:00100000:2.0:1787784510.645527:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:2.0:1787784510.645536:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6167:x1874627727985664:12345-192.168.202.41@tcp:900: 00000100:00100000:2.0:1787784510.645615:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6167:x1874627727985664:12345-192.168.202.41@tcp:900: Request processed in 80us (2486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784510.645622:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:3.0:1787784510.651937:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784510.652305:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727985792 00000100:00100000:2.0:1787784510.652317:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727985792 00000100:00100000:2.0:1787784510.652394:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 198 00000100:00100000:2.0:1787784510.652406:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2408:x1874627727985792:12345-192.168.202.41@tcp:400: 00000100:00100000:2.0:1787784510.652538:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2408:x1874627727985792:12345-192.168.202.41@tcp:400: Request processed in 134us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784510.652547:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 198 00000100:00100000:3.0:1787784510.653158:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784510.653365:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727985920 00000100:00100000:1.0:1787784510.653372:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727985920 00000100:00100000:1.0:1787784510.653424:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:1.0:1787784510.653433:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6167:x1874627727985920:12345-192.168.202.41@tcp:33: 00000004:00080000:0.0:1787784510.694902:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 41347us 00000004:00200000:0.0:1787784510.729586:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787784510.729735:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6167:x1874627727985920:12345-192.168.202.41@tcp:33: Request processed in 76294us (76569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784510.729788:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00010000:00010000:2.0:1787784510.982273:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784511.037344:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784511.037471:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727986048 00000100:00100000:0.0:1787784511.037482:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727986048 00000100:00100000:0.0:1787784511.037555:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:0.0:1787784511.037566:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6210:x1874627727986048:12345-192.168.202.41@tcp:101: 00010000:00010000:0.0:1787784511.037586:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784511.037665:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9cd40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e728c5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784511.037732:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9cd47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784511.037746:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9cd47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784511.037759:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9cd47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784511.037862:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787784511.037866:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784511.037883:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9cd47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784511.037908:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9cd40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728c5 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784511.037944:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9cd47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728c5 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784511.037953:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c23c8400) 00010000:00010000:0.0:1787784511.037956:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784511.037961:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629200, rc 0) 00000100:00100000:0.0:1787784511.038144:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:6210:x1874627727986048:12345-192.168.202.41@tcp:101: Request processed in 578us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784511.038152:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:3.0:1787784511.625283:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750055808:0@lo:41: 00000100:00100000:3.0:1787784511.625366:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784511.625619:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750055808 00000100:00100000:0.0:1787784511.625627:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750055808 00000100:00100000:0.0:1787784511.625684:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787784511.625694:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750055808:12345-0@lo:41: 00000004:00000024:0.0:1787784511.625732:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787784511.625863:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750055808:12345-0@lo:41: Request processed in 170us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784511.625870:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787784511.626094:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750055808:0@lo:41: 00010000:00010000:2.0:1787784512.006273:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784513.033080:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784513.244885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784513.245310:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727986176 00000100:00100000:1.0:1787784513.245321:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727986176 00000100:00100000:1.0:1787784513.245402:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:1.0:1787784513.245415:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:6262:x1874627727986176:12345-192.168.202.41@tcp:41: 00000004:00000024:1.0:1787784513.245456:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:3.0:1787784513.245610:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784513.245705:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:6262:x1874627727986176:12345-192.168.202.41@tcp:41: Request processed in 292us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784513.245712:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:2.0:1787784513.250443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784513.251605:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727986304 00000100:00100000:0.0:1787784513.251616:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727986304 00000100:00080000:3.0:1787784513.251764:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784513.252092:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:0.0:1787784513.252106:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6262:x1874627727986304:12345-192.168.202.41@tcp:41: 00000004:00000024:0.0:1787784513.252146:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787784513.252223:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6262:x1874627727986304:12345-192.168.202.41@tcp:41: Request processed in 121us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784513.252231:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:2.0:1787784513.257877:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784513.258085:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727986432 00000100:00100000:3.0:1787784513.258100:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727986432 00000100:00100000:3.0:1787784513.258180:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:3.0:1787784513.258190:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6262:x1874627727986432:12345-192.168.202.41@tcp:13: 00002000:00000024:3.0:1787784513.258229:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784513.258288:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6262:x1874627727986432:12345-192.168.202.41@tcp:13: Request processed in 99us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784513.258296:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00080000:2.0:1787784513.258436:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784513.260134:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784513.260271:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727986560 00000100:00100000:2.0:1787784513.260279:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727986560 00000100:00100000:2.0:1787784513.260333:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:2.0:1787784513.260343:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6262:x1874627727986560:12345-192.168.202.41@tcp:13: 00002000:00000024:2.0:1787784513.260369:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784513.260422:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e90d38f-8956-47bc-80da-c902c22ae09c+6:6262:x1874627727986560:12345-192.168.202.41@tcp:13: Request processed in 81us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784513.260430:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00080000:3.0:1787784513.262014:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787784514.056002:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784514.694118:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784514.694144:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750055936:0@lo:13: 00000100:00100000:2.0:1787784514.694215:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784514.694336:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750055936 00000100:00100000:3.0:1787784514.694344:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750055936 00000100:00100000:3.0:1787784514.694408:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784514.694418:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750055936:12345-0@lo:13: 00002000:00000024:3.0:1787784514.694440:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784514.694481:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750055936:12345-0@lo:13: Request processed in 65us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784514.694488:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787784514.694562:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787784514.694589:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f534de00 x1874627750055936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784514.694607:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750055936:0@lo:13: 00000100:00100000:0.0:1787784514.695180:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784514.695191:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750056064:0@lo:41: 00000100:00100000:0.0:1787784514.695225:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784514.695272:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750056064 00000100:00100000:0.0:1787784514.695276:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750056064 00000100:00100000:0.0:1787784514.695306:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787784514.695313:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750056064:12345-0@lo:41: 00000004:00000024:0.0:1787784514.695337:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787784514.695372:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750056064:12345-0@lo:41: Request processed in 59us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784514.695379:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787784514.695410:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750056064:0@lo:41: 00000100:00100000:2.0:1787784514.699188:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784514.699213:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750056192:0@lo:13: 00000100:00100000:2.0:1787784514.699292:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784514.699388:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750056192 00000100:00100000:3.0:1787784514.699397:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750056192 00000100:00100000:3.0:1787784514.699462:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787784514.699471:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750056192:12345-0@lo:13: 00002000:00000024:3.0:1787784514.699496:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784514.699546:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750056192:12345-0@lo:13: Request processed in 75us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784514.699554:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787784514.699594:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f534de00 x1874627750056192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784514.699613:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750056192:0@lo:13: 00000100:00080000:2.0:1787784514.699679:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787784514.702603:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00010000:00010000:1.0:1787784515.078245:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784515.206012:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750056320:0@lo:400: 00000100:00100000:0.0:1787784515.206039:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750056448:0@lo:400: 00000100:00100000:3.0:1787784515.206119:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750056576:0@lo:400: 00000100:00100000:2.0:1787784515.206364:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784515.206413:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750056832:0@lo:400: 00000100:00100000:2.0:1787784515.206439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784515.206481:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750057344:0@lo:400: 00000100:00100000:2.0:1787784515.206519:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784515.206537:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750057856:0@lo:400: 00000100:00100000:2.0:1787784515.206555:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784515.206573:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784515.206579:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750057984:0@lo:13: 00000100:00100000:2.0:1787784515.206599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784515.206643:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750056832 00000100:00100000:2.0:1787784515.206650:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750056832 00000100:00100000:2.0:1787784515.206692:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787784515.206701:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750056832:12345-0@lo:400: 00000100:00100000:2.0:1787784515.206754:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750056832:12345-0@lo:400: Request processed in 53us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784515.206761:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787784515.207035:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750056704:0@lo:400: 00000100:00100000:1.0:1787784515.207067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784515.207089:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750057216:0@lo:400: 00000100:00100000:1.0:1787784515.207111:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784515.207129:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750057728:0@lo:400: 00000100:00100000:1.0:1787784515.207148:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784515.207165:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784515.207171:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750058112:0@lo:13: 00000100:00100000:1.0:1787784515.207202:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784515.207231:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750056320 00000100:00100000:1.0:1787784515.207234:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750056320 00000100:00100000:2.0:1787784515.207684:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787784515.207695:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750056320:12345-0@lo:400: 00000100:00100000:2.0:1787784515.207734:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750056320:12345-0@lo:400: Request processed in 41us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784515.207740:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787784515.207896:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750056704 00000100:00100000:1.0:1787784515.207901:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750056704 00000100:00100000:1.0:1787784515.207932:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787784515.207939:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2660780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750056704:12345-0@lo:400: 00000100:00100000:2.0:1787784515.208130:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750056320:0@lo:400: 00000100:00100000:1.0:1787784515.208558:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2660780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750056704:12345-0@lo:400: Request processed in 618us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784515.208568:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787784515.208592:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750057344 00000100:00100000:1.0:1787784515.208597:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750057344 00000100:00100000:1.0:1787784515.208616:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750057856 00000100:00100000:1.0:1787784515.208619:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750057856 00000100:00100000:0.0:1787784515.210443:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784515.210500:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750056960:0@lo:400: 00000100:00100000:0.0:1787784515.210546:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784515.210564:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750057472:0@lo:400: 00000100:00100000:0.0:1787784515.210783:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784515.210872:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750057216 00000100:00100000:0.0:1787784515.210879:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750057216 00000100:00100000:0.0:1787784515.210916:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750057728 00000100:00100000:0.0:1787784515.210919:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750057728 00000100:00100000:0.0:1787784515.210951:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784515.210959:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750057344:12345-0@lo:400: 00000100:00100000:0.0:1787784515.211010:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750057344:12345-0@lo:400: Request processed in 52us (4489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784515.211029:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784515.211046:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784515.211052:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750057216:12345-0@lo:400: 00000100:00100000:0.0:1787784515.211082:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750057216:12345-0@lo:400: Request processed in 31us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784515.211087:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784515.211099:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784515.211105:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750057728:12345-0@lo:400: 00000100:00100000:0.0:1787784515.211132:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750057728:12345-0@lo:400: Request processed in 28us (3984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784515.211138:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784515.211159:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750056448 00000100:00100000:0.0:1787784515.211162:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750056448 00000100:00100000:0.0:1787784515.211650:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750056960 00000100:00100000:0.0:1787784515.211655:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750056960 00000100:00100000:0.0:1787784515.211744:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750057472 00000100:00100000:0.0:1787784515.211749:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750057472 00000100:00100000:0.0:1787784515.211804:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787784515.211812:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750056448:12345-0@lo:400: 00000100:00100000:0.0:1787784515.211857:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750056448:12345-0@lo:400: Request processed in 46us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784515.211863:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787784515.211877:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787784515.211884:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750056960:12345-0@lo:400: 00000100:00100000:0.0:1787784515.211913:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750056960:12345-0@lo:400: Request processed in 30us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784515.211930:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787784515.211945:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787784515.211951:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750057472:12345-0@lo:400: 00000100:00100000:0.0:1787784515.211979:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750057472:12345-0@lo:400: Request processed in 29us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784515.211985:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787784515.212027:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750056448:0@lo:400: 00000100:00100000:0.0:1787784515.212039:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750056960:0@lo:400: 00000100:00100000:0.0:1787784515.212048:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750057472:0@lo:400: 00000100:00100000:0.0:1787784515.212115:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750056704:0@lo:400: 00010000:00080000:0.0:1787784515.212130:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951cffca940 x1874627750057216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784515.212141:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750057216:0@lo:400: 00010000:00080000:0.0:1787784515.212151:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c260bc00 x1874627750057728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784515.212160:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750057728:0@lo:400: 00000100:00100000:0.0:1787784515.212343:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750057984 00000100:00100000:0.0:1787784515.212347:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750057984 00000100:00100000:0.0:1787784515.212371:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750058112 00000100:00100000:0.0:1787784515.212373:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750058112 00000100:00100000:0.0:1787784515.212384:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787784515.212391:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750057984:12345-0@lo:13: 00002000:00000024:0.0:1787784515.212428:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784515.212466:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750057984:12345-0@lo:13: Request processed in 75us (5865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784515.212472:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787784515.212483:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787784515.212490:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2662580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750058112:12345-0@lo:13: 00002000:00000024:0.0:1787784515.212499:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784515.212532:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2662580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750058112:12345-0@lo:13: Request processed in 43us (5330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784515.212537:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787784515.212562:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2660000 x1874627750058112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784515.212637:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750058112:0@lo:13: 00000100:00080000:0.0:1787784515.212725:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784515.212731:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784515.213370:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750056832:0@lo:400: 00010000:00080000:2.0:1787784515.213393:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f534de00 x1874627750057984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784515.213404:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750057984:0@lo:13: 00010000:00080000:2.0:1787784515.213411:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53c8b40 x1874627750057344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784515.213428:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750057344:0@lo:400: 00000100:00100000:1.0:1787784515.214345:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784515.214357:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750057856:12345-0@lo:400: 00000100:00100000:1.0:1787784515.214431:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750057856:12345-0@lo:400: Request processed in 76us (7873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784515.214438:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787784515.215835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784515.216037:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750057088:0@lo:400: 00000100:00100000:3.0:1787784515.216093:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787784515.216096:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c260a580 x1874627750057856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784515.216110:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750057856:0@lo:400: 00000100:00100000:3.0:1787784515.216122:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750057600:0@lo:400: 00000100:00100000:3.0:1787784515.216148:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784515.216297:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750057088 00000100:00100000:1.0:1787784515.216303:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750057088 00000100:00100000:1.0:1787784515.216354:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750057600 00000100:00100000:1.0:1787784515.216358:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750057600 00000100:00100000:1.0:1787784515.216381:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787784515.216389:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750057088:12345-0@lo:400: 00000100:00100000:1.0:1787784515.216434:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750057088:12345-0@lo:400: Request processed in 46us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784515.216442:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787784515.216455:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787784515.216468:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750057600:12345-0@lo:400: 00000100:00100000:1.0:1787784515.216496:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750057600:12345-0@lo:400: Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784515.216502:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787784515.216577:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787784515.216595:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951cffc9680 x1874627750057088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784515.216605:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750057088:0@lo:400: 00010000:00080000:2.0:1787784515.216616:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53cb0c0 x1874627750057600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784515.216623:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750057600:0@lo:400: 00000100:00100000:0.0:1787784515.223817:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750056576 00000100:00100000:0.0:1787784515.223831:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750056576 00000100:00100000:0.0:1787784515.223914:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787784515.223925:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750056576:12345-0@lo:400: 00000100:00100000:0.0:1787784515.224041:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750056576:12345-0@lo:400: Request processed in 117us (8208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784515.224047:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787784515.224183:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750056576:0@lo:400: 00000001:00100000:1.0:1787784515.727302:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00000001:00100000:0.0:1787784515.728197:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00000100:00100000:3.0:1787784515.874033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784515.874076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784515.874102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784515.874121:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784515.874143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784515.874172:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727986944 00000100:00100000:3.0:1787784515.874182:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727986944 00000100:00100000:3.0:1787784515.874241:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727986816 00000100:00100000:3.0:1787784515.874244:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727986816 00000100:00100000:3.0:1787784515.874270:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:3.0:1787784515.874281:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff488b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627727986944:12345-192.168.202.41@tcp:400: 00000100:00100000:3.0:1787784515.874366:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff488b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627727986944:12345-192.168.202.41@tcp:400: Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784515.874374:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:3.0:1787784515.874391:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:3.0:1787784515.874396:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff489e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2407:x1874627727986816:12345-192.168.202.41@tcp:400: 00000100:00100000:3.0:1787784515.874459:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff489e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2407:x1874627727986816:12345-192.168.202.41@tcp:400: Request processed in 61us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784515.874470:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:3.0:1787784515.874492:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727987200 00000100:00100000:3.0:1787784515.874495:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727987200 00000100:00100000:3.0:1787784515.874520:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727987072 00000100:00100000:3.0:1787784515.874523:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727987072 00000100:00100000:3.0:1787784515.874543:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:3.0:1787784515.874550:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627727987200:12345-192.168.202.41@tcp:400: 00000100:00100000:3.0:1787784515.874574:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627727987200:12345-192.168.202.41@tcp:400: Request processed in 26us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784515.874581:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:3.0:1787784515.874591:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:3.0:1787784515.874598:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2407:x1874627727987072:12345-192.168.202.41@tcp:400: 00000100:00100000:3.0:1787784515.874623:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2407:x1874627727987072:12345-192.168.202.41@tcp:400: Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784515.874630:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00080000:3.0:1787784515.874648:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787784515.874651:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787784515.874653:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784515.874656:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787784515.875116:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727986688 00000100:00100000:1.0:1787784515.875121:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727986688 00000100:00100000:1.0:1787784515.875153:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 200 00000100:00100000:1.0:1787784515.875175:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2407:x1874627727986688:12345-192.168.202.41@tcp:400: 00000100:00100000:1.0:1787784515.875222:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2407:x1874627727986688:12345-192.168.202.41@tcp:400: Request processed in 62us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784515.875229:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 200 00010000:00010000:2.0:1787784516.102081:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787784516.376631:0:10186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787784516.742126:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784516.742163:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750058240:0@lo:41: 00000100:00100000:3.0:1787784516.742233:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784516.742388:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750058240 00000100:00100000:0.0:1787784516.742396:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750058240 00000100:00100000:0.0:1787784516.742452:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787784516.742462:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750058240:12345-0@lo:41: 00000004:00000024:0.0:1787784516.742512:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787784516.742565:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750058240:12345-0@lo:41: Request processed in 104us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784516.742572:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787784516.742616:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750058240:0@lo:41: 00000001:00100000:1.0:1787784516.747698:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00010000:00010000:1.0:1787784517.126242:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784518.150124:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784519.176731:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784519.814045:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784519.814091:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750058368:0@lo:41: 00000100:00100000:0.0:1787784519.815342:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784519.815573:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750058368 00000100:00100000:3.0:1787784519.815584:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750058368 00000100:00100000:3.0:1787784519.815641:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787784519.815650:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750058368:12345-0@lo:41: 00000004:00000024:3.0:1787784519.815718:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787784519.815820:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750058368:12345-0@lo:41: Request processed in 170us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784519.815827:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787784519.815988:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750058368:0@lo:41: 00000100:00100000:0.0:1787784519.816020:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750058496:0@lo:13: 00000100:00100000:0.0:1787784519.816053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784519.816191:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750058496 00000100:00100000:3.0:1787784519.816196:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750058496 00000100:00100000:3.0:1787784519.816252:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784519.816272:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750058496:12345-0@lo:13: 00002000:00000024:3.0:1787784519.816297:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784519.816337:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750058496:12345-0@lo:13: Request processed in 78us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784519.816343:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787784519.816372:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff488780 x1874627750058496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784519.816388:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750058496:0@lo:13: 00000100:00080000:0.0:1787784519.816729:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784519.822873:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784519.822917:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750058624:0@lo:13: 00000100:00100000:0.0:1787784519.823024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784519.823117:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750058624 00000100:00100000:0.0:1787784519.823126:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750058624 00000100:00100000:0.0:1787784519.823218:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787784519.823229:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750058624:12345-0@lo:13: 00002000:00000024:0.0:1787784519.823267:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784519.823320:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750058624:12345-0@lo:13: Request processed in 92us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784519.823328:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787784519.823359:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787784519.823393:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c260a580 x1874627750058624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784519.823460:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750058624:0@lo:13: 00010000:00010000:2.0:1787784520.198045:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784520.326020:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784520.326061:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750058752:0@lo:13: 00000100:00100000:1.0:1787784520.326163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784520.326307:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750058752 00000100:00100000:0.0:1787784520.326319:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750058752 00000100:00100000:0.0:1787784520.326401:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787784520.326415:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750058752:12345-0@lo:13: 00002000:00000024:0.0:1787784520.326455:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784520.326573:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750058880:0@lo:400: 00000100:00100000:3.0:1787784520.326625:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784520.326664:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750059392:0@lo:400: 00000100:00100000:3.0:1787784520.326692:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784520.326710:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750059904:0@lo:400: 00000100:00100000:3.0:1787784520.326783:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784520.326817:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787784520.326822:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750059008:0@lo:400: 00000100:00100000:3.0:1787784520.326847:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784520.326863:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750059520:0@lo:400: 00000100:00100000:3.0:1787784520.326892:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784520.326927:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750058880 00000100:00100000:3.0:1787784520.326931:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750058880 00000100:00100000:3.0:1787784520.326964:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787784520.326971:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750058880:12345-0@lo:400: 00000100:00100000:3.0:1787784520.327008:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750058880:12345-0@lo:400: Request processed in 38us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.327016:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787784520.327051:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750059392 00000100:00100000:3.0:1787784520.327055:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750059392 00000100:00100000:3.0:1787784520.327083:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750059008 00000100:00100000:3.0:1787784520.327086:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750059008 00000100:00100000:3.0:1787784520.327099:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750059520 00000100:00100000:3.0:1787784520.327102:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750059520 00000100:00100000:3.0:1787784520.327117:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787784520.327120:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784520.327123:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff489a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750059392:12345-0@lo:400: 00000100:00080000:1.0:1787784520.327125:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784520.327128:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784520.327200:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750058752:12345-0@lo:13: Request processed in 102us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784520.327209:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787784520.327236:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750059264:0@lo:400: 00000100:00100000:0.0:1787784520.327268:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784520.327282:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750059776:0@lo:400: 00000100:00100000:0.0:1787784520.327304:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784520.327318:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787784520.327324:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750059136:0@lo:400: 00000100:00100000:0.0:1787784520.327346:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784520.327365:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff488f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750059648:0@lo:400: 00000100:00100000:0.0:1787784520.327387:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784520.327408:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750059136 00000100:00100000:0.0:1787784520.327412:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750059136 00000100:00100000:0.0:1787784520.327441:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787784520.327448:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750059136:12345-0@lo:400: 00000100:00100000:0.0:1787784520.327489:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750059136:12345-0@lo:400: Request processed in 41us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784520.327497:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787784520.327551:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750059136:0@lo:400: 00010000:00080000:0.0:1787784520.327592:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c26630c0 x1874627750058752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784520.327610:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750058752:0@lo:13: 00000100:00100000:3.0:1787784520.328324:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff489a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750059392:12345-0@lo:400: Request processed in 1196us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.328335:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787784520.328354:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750059264 00000100:00100000:3.0:1787784520.328358:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750059264 00000100:00100000:3.0:1787784520.328375:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750059776 00000100:00100000:3.0:1787784520.328377:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750059776 00000100:00100000:1.0:1787784520.328419:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750060032:0@lo:13: 00000100:00100000:1.0:1787784520.328461:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784520.328471:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750059648 00000100:00100000:3.0:1787784520.328475:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750059648 00000100:00100000:0.0:1787784520.328514:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750060032 00000100:00100000:0.0:1787784520.328518:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750060032 00000100:00100000:0.0:1787784520.328548:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784520.328556:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2661680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750060032:12345-0@lo:13: 00000100:00100000:3.0:1787784520.328562:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787784520.328568:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750059008:12345-0@lo:400: 00002000:00000024:0.0:1787784520.328587:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784520.328602:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750059008:12345-0@lo:400: Request processed in 35us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.328880:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787784520.328899:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787784520.328906:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2666d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750059520:12345-0@lo:400: 00000100:00100000:3.0:1787784520.328938:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2666d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750059520:12345-0@lo:400: Request processed in 34us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.328945:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787784520.328955:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787784520.328961:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750059264:12345-0@lo:400: 00000100:00100000:3.0:1787784520.328996:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750059264:12345-0@lo:400: Request processed in 36us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.329002:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787784520.329013:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787784520.329018:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750059776:12345-0@lo:400: 00000100:00100000:3.0:1787784520.329044:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750059776:12345-0@lo:400: Request processed in 27us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.329049:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787784520.329058:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787784520.329064:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750059648:12345-0@lo:400: 00000100:00100000:3.0:1787784520.329090:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750059648:12345-0@lo:400: Request processed in 27us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.329095:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787784520.329119:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750059904 00000100:00100000:3.0:1787784520.329122:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750059904 00000100:00100000:3.0:1787784520.330291:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784520.330306:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2665e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750059904:12345-0@lo:400: 00000100:00100000:3.0:1787784520.330390:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2665e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750059904:12345-0@lo:400: Request processed in 89us (3621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.330410:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787784520.330466:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787784520.330472:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784520.330476:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784520.330528:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750059008:0@lo:400: 00010000:00080000:3.0:1787784520.330546:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48a1c0 x1874627750059520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784520.330557:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750059520:0@lo:400: 00000100:00100000:3.0:1787784520.330569:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750058880:0@lo:400: 00000100:00100000:3.0:1787784520.330581:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750059392:0@lo:400: 00010000:00080000:3.0:1787784520.330591:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff489680 x1874627750059904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784520.330599:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750059904:0@lo:400: 00000100:00100000:0.0:1787784520.331941:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2661680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750060032:12345-0@lo:13: Request processed in 3376us (3469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784520.331957:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784520.332085:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff488f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750059648:0@lo:400: 00000100:00100000:0.0:1787784520.332100:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750059264:0@lo:400: 00010000:00080000:0.0:1787784520.332118:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48b840 x1874627750059776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784520.332129:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750059776:0@lo:400: 00010000:00080000:1.0:1787784520.342496:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951cffc9680 x1874627750060032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784520.342535:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750060032:0@lo:13: 00000100:00100000:3.0:1787784520.989898:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784520.989958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784520.990004:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784520.990030:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784520.990079:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784520.990119:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727987328 00000100:00100000:3.0:1787784520.990134:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727987328 00000100:00100000:3.0:1787784520.990204:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00100000:3.0:1787784520.990216:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2405:x1874627727987328:12345-192.168.202.41@tcp:400: 00000100:00100000:3.0:1787784520.990326:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2405:x1874627727987328:12345-192.168.202.41@tcp:400: Request processed in 112us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.990335:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00100000:3.0:1787784520.990378:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727987456 00000100:00100000:3.0:1787784520.990383:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727987456 00000100:00100000:3.0:1787784520.990440:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727987584 00000100:00100000:3.0:1787784520.990444:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727987584 00000100:00100000:3.0:1787784520.990470:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:3.0:1787784520.990477:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2665a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627727987456:12345-192.168.202.41@tcp:400: 00000100:00100000:3.0:1787784520.990514:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2665a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627727987456:12345-192.168.202.41@tcp:400: Request processed in 36us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.990521:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:3.0:1787784520.990534:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:3.0:1787784520.990540:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627727987584:12345-192.168.202.41@tcp:400: 00000100:00100000:3.0:1787784520.990564:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627727987584:12345-192.168.202.41@tcp:400: Request processed in 24us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.990570:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:3.0:1787784520.990590:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727987712 00000100:00100000:3.0:1787784520.990594:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727987712 00000100:00100000:3.0:1787784520.990620:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727987840 00000100:00100000:3.0:1787784520.990622:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727987840 00000100:00100000:3.0:1787784520.990644:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:3.0:1787784520.990650:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2664780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627727987712:12345-192.168.202.41@tcp:400: 00000100:00100000:3.0:1787784520.990681:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2664780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627727987712:12345-192.168.202.41@tcp:400: Request processed in 31us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.990688:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:3.0:1787784520.990708:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:3.0:1787784520.990715:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627727987840:12345-192.168.202.41@tcp:400: 00000100:00100000:3.0:1787784520.990802:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627727987840:12345-192.168.202.41@tcp:400: Request processed in 87us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.990810:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00080000:3.0:1787784520.990979:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787784520.990985:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787784520.990988:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784520.990990:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1787784521.209729:0:10333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2188d1e0 20000000:00000080:0.0:1787784521.209765:0:10333:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8951f5351400 uarg=0000000000000000 20000000:01000000:0.0:1787784521.209850:0:10333:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787784521.209854:0:10333:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787784521.209858:0:10333:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787784521.209864:0:10333:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787784521.209870:0:10333:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787784521.210446:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787784521.210459:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787784521.215548:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1787784521.220593:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1787784521.220638:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1787784521.220655:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1787784521.220669:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787784521.220672:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787784521.221726:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00010000:00010000:3.0:1787784521.222985:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784521.224311:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1787784521.224351:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1787784521.224367:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1787784521.224380:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787784521.224383:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787784521.225181:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1787784521.225373:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1787784521.225475:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1787784521.225516:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1787784521.225527:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787784521.225529:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787784521.230242:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1787784521.238693:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1787784521.238759:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1787784521.238807:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1787784521.238831:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787784521.238834:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787784521.239634:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1787784521.240910:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1787784521.240978:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1787784521.240998:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:0.0:1787784521.241024:0:10333:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787784521.241052:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241075:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d34800/0x88ace7295d9cbe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cbe2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241083:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cc13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cc0c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241091:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951d1628400/0x88ace7295d9cc52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cc4b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241097:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d34400/0x88ace7295d9cc60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cc59 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241104:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff895201c5b400/0x88ace7295d9cc6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cc67 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241111:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c0031400/0x88ace7295d9cc8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cc83 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241118:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ccb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ccad expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241125:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff895201c5b200/0x88ace7295d9ccd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ccc9 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241143:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ccfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ccf3 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241154:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72855 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241171:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff895201c5b600/0x88ace7295d9cd0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7285c expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241180:0:10333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241237:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff895201c5b600/0x88ace7295d9cd0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7285c expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241259:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff895201c5b600/0x88ace7295d9cd0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7285c expref: 9 pid: 6513 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.241278:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750060160:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784521.241420:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72855 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241429:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72855 expref: 9 pid: 6514 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.241438:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750060288:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784521.241469:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ccfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ccf3 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241489:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ccfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ccf3 expref: 23 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.241499:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750060416:0@lo:104: 00000100:00100000:0.0:1787784521.241550:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784521.241616:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750060416 00000100:00100000:0.0:1787784521.241625:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750060416 00000100:00100000:0.0:1787784521.241681:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787784521.241691:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750060416:12345-0@lo:104: 00010000:00010000:0.0:1787784521.241707:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ccfa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241796:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784521.241803:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750060416:12345-0@lo:104: Request processed in 113us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784521.241810:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787784521.241836:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784521.241843:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ccfa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241851:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35a00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784521.241856:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ccfa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241866:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ccfa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784521.241873:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ccfa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784521.241887:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784521.241919:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ccfa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241926:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784521.241948:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ccfa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241957:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9ccf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ccfa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.241974:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784521.241976:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784521.241978:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784521.241993:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750060544:0@lo:103: 00000100:00100000:0.0:1787784521.242029:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784521.242078:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750060544 00000100:00100000:0.0:1787784521.242082:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750060544 00010000:00010000:0.0:1787784521.242101:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ccfa lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ccf3 expref: 24 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.242128:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787784521.242134:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750060544:12345-0@lo:103: 00010000:00010000:0.0:1787784521.242147:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784521.242152:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ccfa lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ccf3 expref: 24 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242162:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ccfa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ccf3 expref: 24 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242188:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784521.242218:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750060544:12345-0@lo:103: Request processed in 84us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784521.242226:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787784521.242295:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750060544:0@lo:103: 00010000:00010000:0.0:1787784521.242331:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff895201c5b200/0x88ace7295d9ccd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ccc9 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242341:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff895201c5b200/0x88ace7295d9ccd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ccc9 expref: 23 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.242351:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750060672:0@lo:104: 00000100:00100000:0.0:1787784521.242375:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784521.242396:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750060672 00000100:00100000:0.0:1787784521.242400:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750060672 00000100:00100000:0.0:1787784521.242417:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784521.242423:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750060672:12345-0@lo:104: 00010000:00010000:0.0:1787784521.242431:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ccd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242462:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784521.242467:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750060672:12345-0@lo:104: Request processed in 44us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784521.242473:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1787784521.242502:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ccb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ccad expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242510:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ccb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ccad expref: 23 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.242525:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750060800:0@lo:104: 00000100:00100000:0.0:1787784521.242547:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784521.242567:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750060800 00000100:00100000:0.0:1787784521.242570:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750060800 00000100:00100000:0.0:1787784521.242586:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784521.242591:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750060800:12345-0@lo:104: 00010000:00010000:0.0:1787784521.242598:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ccb4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242629:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787784521.242633:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750060800:12345-0@lo:104: Request processed in 43us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784521.242639:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1787784521.242652:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784521.242656:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ccd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242662:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5a600 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784521.242666:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ccd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242672:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ccd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784521.242679:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ccd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784521.242685:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784521.242708:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ccd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242714:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784521.242726:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ccd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242733:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff895201c5a600/0x88ace7295d9ccc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ccd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242760:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784521.242763:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ccb4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242795:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784521.242798:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ccb4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242805:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ccb4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784521.242810:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ccb4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784521.242816:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784521.242829:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ccb4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242835:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784521.242851:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ccb4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242869:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ccad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ccb4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242879:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784521.242880:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784521.242882:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784521.242892:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750060928:0@lo:103: 00000100:00100000:0.0:1787784521.242921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784521.242980:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c0031400/0x88ace7295d9cc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cc83 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.242988:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951c0031400/0x88ace7295d9cc8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cc83 expref: 23 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.242997:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750061184:0@lo:104: 00000100:00100000:0.0:1787784521.243021:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784521.243053:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787784521.243061:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750061184 00000100:00100000:0.0:1787784521.243065:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750061184 00000100:00100000:0.0:1787784521.243082:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787784521.243088:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750061184:12345-0@lo:104: 00010000:00010000:0.0:1787784521.243096:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cc8a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243129:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784521.243134:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750061184:12345-0@lo:104: Request processed in 47us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784521.243148:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787784521.243181:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784521.243186:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cc8a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243193:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784521.243196:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cc8a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243203:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cc8a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784521.243209:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cc8a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784521.243214:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784521.243230:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc8a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243235:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784521.243241:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc8a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243247:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cc83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc8a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243255:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784521.243257:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784521.243258:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784521.243275:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff895201c5b400/0x88ace7295d9cc6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cc67 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243289:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff895201c5b400/0x88ace7295d9cc6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cc67 expref: 23 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.243297:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750061440:0@lo:104: 00000100:00100000:0.0:1787784521.243320:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784521.243338:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750061440 00000100:00100000:0.0:1787784521.243341:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750061440 00000100:00100000:0.0:1787784521.243357:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787784521.243362:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2608f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750061440:12345-0@lo:104: 00010000:00010000:0.0:1787784521.243370:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cc6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243399:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784521.243404:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2608f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750061440:12345-0@lo:104: Request processed in 42us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784521.243410:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1787784521.243423:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784521.243426:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cc6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243432:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151e400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784521.243435:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cc6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243441:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cc6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784521.243447:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cc6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784521.243459:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784521.243473:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243480:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784521.243490:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243498:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c151e400/0x88ace7295d9cc67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243509:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784521.243511:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784521.243512:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784521.243521:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9d70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750061568:0@lo:103: 00000100:00100000:0.0:1787784521.243547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784521.243593:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d34400/0x88ace7295d9cc60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cc59 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243602:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951e1d34400/0x88ace7295d9cc60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cc59 expref: 23 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.243610:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750061696:0@lo:104: 00000100:00100000:0.0:1787784521.243632:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784521.243650:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750061696 00000100:00100000:0.0:1787784521.243653:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750061696 00000100:00100000:0.0:1787784521.243670:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787784521.243675:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750061696:12345-0@lo:104: 00010000:00010000:0.0:1787784521.243691:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cc60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.243722:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784521.243728:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750061696:12345-0@lo:104: Request processed in 52us (95us total) trans 0 rc 0/0 00010000:00010000:3.0:1787784521.243948:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784521.243956:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cc60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.243964:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5aa00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784521.243968:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cc60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.243975:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cc60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784521.243982:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cc60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784521.243988:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787784521.244020:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.244032:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784521.244047:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.244054:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff895201c5aa00/0x88ace7295d9cc59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.244067:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784521.244069:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784521.244070:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784521.244083:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750061056:0@lo:103: 00000100:00100000:3.0:1787784521.244118:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784521.244175:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784521.244183:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750061312:0@lo:103: 00000100:00100000:3.0:1787784521.244206:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784521.244230:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2666580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750061824:0@lo:103: 00000100:00100000:3.0:1787784521.244251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784521.244278:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750060928 00000100:00100000:3.0:1787784521.244284:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750060928 00010000:00010000:3.0:1787784521.244309:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff895201c5b200/0x88ace7295d9ccd0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ccc9 expref: 24 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784521.244325:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750061568 00000100:00100000:3.0:1787784521.244328:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750061568 00010000:00010000:3.0:1787784521.244340:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff895201c5b400/0x88ace7295d9cc6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cc67 expref: 25 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784521.244351:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750061056 00000100:00100000:3.0:1787784521.244359:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750061056 00010000:00010000:3.0:1787784521.244373:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ccb4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ccad expref: 26 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784521.244386:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750061312 00000100:00100000:3.0:1787784521.244389:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750061312 00010000:00010000:3.0:1787784521.244398:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c0031400/0x88ace7295d9cc8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cc83 expref: 27 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784521.244408:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750061824 00000100:00100000:3.0:1787784521.244411:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750061824 00010000:00010000:3.0:1787784521.244421:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d34400/0x88ace7295d9cc60 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cc59 expref: 28 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784521.244432:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787784521.244438:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+28:3647:x1874627750060928:12345-0@lo:103: 00010000:00010000:3.0:1787784521.244452:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784521.244457:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff895201c5b200/0x88ace7295d9ccd0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ccc9 expref: 28 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.244468:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff895201c5b200/0x88ace7295d9ccd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ccc9 expref: 28 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.244489:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784521.244519:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+28:3647:x1874627750060928:12345-0@lo:103: Request processed in 81us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784521.244526:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787784521.244541:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787784521.244547:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+27:3646:x1874627750061568:12345-0@lo:103: 00010000:00010000:3.0:1787784521.244554:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784521.244565:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff895201c5b400/0x88ace7295d9cc6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cc67 expref: 27 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.244573:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff895201c5b400/0x88ace7295d9cc6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cc67 expref: 27 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.244582:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784521.244609:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+27:3646:x1874627750061568:12345-0@lo:103: Request processed in 62us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784521.244616:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787784521.244628:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784521.244634:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+26:3644:x1874627750061056:12345-0@lo:103: 00010000:00010000:3.0:1787784521.244641:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784521.244644:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ccb4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ccad expref: 26 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.244651:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ccb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ccad expref: 26 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.244660:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784521.244683:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+26:3644:x1874627750061056:12345-0@lo:103: Request processed in 50us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784521.244690:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784521.244701:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787784521.244708:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+25:3644:x1874627750061312:12345-0@lo:103: 00010000:00010000:3.0:1787784521.244714:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784521.244718:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c0031400/0x88ace7295d9cc8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cc83 expref: 25 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.244748:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c0031400/0x88ace7295d9cc8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cc83 expref: 25 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.244757:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784521.244834:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+25:3644:x1874627750061312:12345-0@lo:103: Request processed in 127us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784521.244841:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787784521.244854:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787784521.244860:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2664f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3647:x1874627750061824:12345-0@lo:103: 00010000:00010000:3.0:1787784521.244867:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784521.244871:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d34400/0x88ace7295d9cc60 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cc59 expref: 24 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.244879:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d34400/0x88ace7295d9cc60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cc59 expref: 24 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.244889:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784521.244910:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2664f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3647:x1874627750061824:12345-0@lo:103: Request processed in 49us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784521.244916:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787784521.244954:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2666580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750061824:0@lo:103: 00000100:00100000:3.0:1787784521.244966:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750060928:0@lo:103: 00000100:00100000:3.0:1787784521.244994:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9d70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750061568:0@lo:103: 00000100:00100000:3.0:1787784521.245016:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750061312:0@lo:103: 00000100:00100000:3.0:1787784521.245023:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750061056:0@lo:103: 00000100:00100000:0.0:1787784521.246412:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1787784521.246465:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784521.246539:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951d1628400/0x88ace7295d9cc52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cc4b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.246557:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951d1628400/0x88ace7295d9cc52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cc4b expref: 23 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.246575:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750061952:0@lo:104: 00000100:00100000:0.0:1787784521.246659:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784521.246701:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cc0c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.246709:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cc13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cc0c expref: 23 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.246716:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750062080:0@lo:104: 00000100:00100000:0.0:1787784521.246749:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784521.246889:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d34800/0x88ace7295d9cbe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cbe2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.246899:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951e1d34800/0x88ace7295d9cbe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cbe2 expref: 23 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.246936:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750062208:0@lo:104: 00000100:00100000:0.0:1787784521.246969:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784521.247343:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f527a780 going to sleep for 11 seconds 00010000:00010000:0.0:1787784521.247381:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34200/0x88ace7295d9ccfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ccf3 expref: 23 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.247406:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750060416:0@lo:104: 00010000:00010000:0.0:1787784521.247422:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5b200/0x88ace7295d9ccd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ccc9 expref: 22 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.247431:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750060672:0@lo:104: 00010000:00010000:0.0:1787784521.247444:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34600/0x88ace7295d9ccb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ccad expref: 21 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.247453:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750060800:0@lo:104: 00010000:00010000:0.0:1787784521.247462:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c0031400/0x88ace7295d9cc8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cc83 expref: 20 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.247471:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750061184:0@lo:104: 00010000:00010000:0.0:1787784521.247481:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5b400/0x88ace7295d9cc6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cc67 expref: 19 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.247489:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750061440:0@lo:104: 00010000:00010000:0.0:1787784521.247498:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34400/0x88ace7295d9cc60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cc59 expref: 18 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.247505:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750061696:0@lo:104: 00000100:00100000:2.0:1787784521.247621:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750061952 00000100:00100000:2.0:1787784521.247630:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750061952 00000100:00100000:2.0:1787784521.247679:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750062080 00000100:00100000:2.0:1787784521.247683:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750062080 00000100:00100000:2.0:1787784521.247694:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750062208 00000100:00100000:2.0:1787784521.247696:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750062208 00000100:00100000:2.0:1787784521.247709:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787784521.247718:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+5:10333:x1874627750061952:12345-0@lo:104: 00010000:00010000:2.0:1787784521.247746:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cc52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248208:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784521.248215:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+5:10333:x1874627750061952:12345-0@lo:104: Request processed in 498us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784521.248224:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787784521.248246:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787784521.248253:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff488f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:10333:x1874627750062080:12345-0@lo:104: 00010000:00010000:2.0:1787784521.248262:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cc13 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248297:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787784521.248302:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff488f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:10333:x1874627750062080:12345-0@lo:104: Request processed in 52us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784521.248308:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787784521.248319:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787784521.248325:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750062208:12345-0@lo:104: 00010000:00010000:2.0:1787784521.248341:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cbe9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248370:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787784521.248375:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10333:x1874627750062208:12345-0@lo:104: Request processed in 51us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784521.248381:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1787784521.248404:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787784521.248412:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cc52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248419:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f600 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784521.248424:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cc52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248432:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cc52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784521.248440:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cc52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784521.248446:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784521.248484:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248491:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784521.248510:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248518:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c151f600/0x88ace7295d9cc4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248536:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784521.248540:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cc13 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248545:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ba00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784521.248547:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cc13 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248553:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cc13 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784521.248560:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cc13 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784521.248565:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784521.248577:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc13 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248582:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784521.248587:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc13 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248593:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9cc0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc13 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248600:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784521.248602:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cbe9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248617:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784521.248621:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cbe9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248628:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cbe9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784521.248634:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cbe9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784521.248639:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784521.248652:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cbe9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248658:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784521.248673:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cbe9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248680:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1629800/0x88ace7295d9cbe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cbe9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784521.248696:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784521.248698:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784521.248700:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784521.248716:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750062464:0@lo:103: 00000100:00100000:2.0:1787784521.248794:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784521.248832:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784521.248838:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750062336:0@lo:103: 00000100:00100000:2.0:1787784521.248873:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784521.248901:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750062464 00000100:00100000:2.0:1787784521.248906:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750062464 00010000:00010000:2.0:1787784521.248941:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cc13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cc0c expref: 18 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.249072:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750061952:0@lo:104: 00000100:00100000:0.0:1787784521.249084:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750062080:0@lo:104: 00000100:00100000:0.0:1787784521.249094:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750062208:0@lo:104: 00000100:00100000:2.0:1787784521.249262:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750062336 00000100:00100000:2.0:1787784521.249267:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750062336 00010000:00010000:2.0:1787784521.249282:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951d1628400/0x88ace7295d9cc52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cc4b expref: 19 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.249625:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784521.249656:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750062592:0@lo:103: 00000100:00100000:3.0:1787784521.249701:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784521.250156:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750062592 00000100:00100000:0.0:1787784521.250164:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750062592 00010000:00010000:0.0:1787784521.250189:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d34800/0x88ace7295d9cbe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cbe2 expref: 20 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.250210:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787784521.250220:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+20:3645:x1874627750062464:12345-0@lo:103: 00010000:00010000:0.0:1787784521.250237:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784521.250244:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cc13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cc0c expref: 20 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.250255:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cc0c expref: 20 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.250277:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cc13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cc0c expref: 20 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.250297:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784521.250341:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+19:3645:x1874627750062464:12345-0@lo:103: Request processed in 122us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784521.250348:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787784521.250367:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787784521.250373:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+18:3645:x1874627750062336:12345-0@lo:103: 00010000:00010000:0.0:1787784521.250380:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784521.250384:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951d1628400/0x88ace7295d9cc52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cc4b expref: 18 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.250404:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951d1628400/0x88ace7295d9cc52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cc4b expref: 18 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.250415:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1628400/0x88ace7295d9cc52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cc4b expref: 18 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.250425:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784521.250448:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+17:3645:x1874627750062336:12345-0@lo:103: Request processed in 76us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784521.250455:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787784521.250501:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787784521.250507:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2666580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+16:3646:x1874627750062592:12345-0@lo:103: 00010000:00010000:0.0:1787784521.250514:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784521.250518:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d34800/0x88ace7295d9cbe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cbe2 expref: 16 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.250526:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d34800/0x88ace7295d9cbe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cbe2 expref: 16 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.250536:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34800/0x88ace7295d9cbe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cbe2 expref: 16 pid: 6513 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.250546:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784521.250574:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2666580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+15:3646:x1874627750062592:12345-0@lo:103: Request processed in 68us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784521.250581:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787784521.250679:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750062336:0@lo:103: 00000100:00100000:2.0:1787784521.250689:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750062464:0@lo:103: 00000100:00100000:2.0:1787784521.250891:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750062592:0@lo:103: 00000100:00100000:0.0:1787784521.251659:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750060160:192.168.202.41@tcp:104: 00000100:00100000:0.0:1787784521.251671:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874627750060288:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784521.251726:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784521.254464:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784521.254637:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784521.255456:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727987968 00000100:00100000:0.0:1787784521.255471:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727987968 00010000:00010000:0.0:1787784521.255529:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff895201c5b600/0x88ace7295d9cd0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7285c expref: 10 pid: 6513 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.255581:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727988096 00000100:00100000:0.0:1787784521.255585:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727988096 00010000:00010000:0.0:1787784521.255599:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72855 expref: 11 pid: 6514 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784521.255619:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:0.0:1787784521.255630:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2667840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+11:2405:x1874627727987968:12345-192.168.202.41@tcp:103: 00010000:00010000:0.0:1787784521.255652:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784521.255660:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff895201c5b600/0x88ace7295d9cd0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7285c expref: 11 pid: 6513 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.255675:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff895201c5b600/0x88ace7295d9cd0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7285c expref: 11 pid: 6513 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.255699:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5b600/0x88ace7295d9cd0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7285c expref: 11 pid: 6513 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.255720:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784521.255838:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2667840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2405:x1874627727987968:12345-192.168.202.41@tcp:103: Request processed in 208us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784521.255847:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:0.0:1787784521.255869:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:0.0:1787784521.255899:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2665680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+9:2405:x1874627727988096:12345-192.168.202.41@tcp:103: 00010000:00010000:0.0:1787784521.255907:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784521.256196:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72855 expref: 9 pid: 6514 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.256211:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72855 expref: 9 pid: 6514 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.256223:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72855 expref: 9 pid: 6514 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.256235:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.256244:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.256263:0:8452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.256270:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.256277:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.256285:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.256292:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784521.256297:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.256314:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.262665:0:10333:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784521.262690:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.263496:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.263514:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd4e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784521.263542:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784521.263714:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2665680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+8:2405:x1874627727988096:12345-192.168.202.41@tcp:103: Request processed in 7808us (9069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784521.263728:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:3.0:1787784521.862318:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750062720:0@lo:41: 00000100:00100000:3.0:1787784521.862433:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784521.862587:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750062720 00000100:00100000:0.0:1787784521.862598:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750062720 00000100:00100000:0.0:1787784521.862668:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787784521.862679:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2666940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750062720:12345-0@lo:41: 00000004:00000024:0.0:1787784521.862723:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784521.862816:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2666940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750062720:12345-0@lo:41: Request processed in 138us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784521.862824:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787784521.862881:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750062720:0@lo:41: 00010000:00010000:2.0:1787784522.252142:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787784522.886968:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787784522.886979:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951f53b5800 from 48 10000000:01000000:3.0:1787784522.886987:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787784522.887054:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.887068:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.887081:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784522.887112:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750062848:0@lo:101: 00000100:00100000:3.0:1787784522.887207:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784522.887342:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784522.888005:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750062848 00000100:00100000:1.0:1787784522.888016:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750062848 00000100:00100000:1.0:1787784522.888089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787784522.888102:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+15:6518:x1874627750062848:12345-0@lo:101: 00010000:00010000:1.0:1787784522.888120:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784522.888142:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cd55 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.888174:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cd55 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.888187:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cd55 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.888198:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35200, rc 0) 00000100:00100000:1.0:1787784522.888322:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750062848:12345-0@lo:101: Request processed in 222us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784522.888329:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787784522.891123:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750062848:0@lo:101: 00010000:00010000:2.0:1787784522.891168:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784522.891184:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784522.891314:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750062976:0@lo:501: 00000100:00100000:2.0:1787784522.891397:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.891534:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784522.892519:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750062976 00000100:00100000:3.0:1787784522.892552:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750062976 00000100:00100000:3.0:1787784522.892685:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787784522.892697:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750062976:12345-0@lo:501: 00000100:00100000:3.0:1787784522.893051:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750062976:12345-0@lo:501: Request processed in 354us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784522.893061:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787784522.893171:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750062976:0@lo:501: 00000100:00100000:2.0:1787784522.893235:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750063104:0@lo:503: 00000100:00100000:2.0:1787784522.893303:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.896413:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784522.896698:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750063104 00000100:00100000:1.0:1787784522.896711:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750063104 00000100:00100000:1.0:1787784522.896803:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787784522.896815:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750063104:12345-0@lo:503: 00000100:00100000:1.0:1787784522.897044:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750063104:12345-0@lo:503: Request processed in 231us (3740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784522.897054:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787784522.897285:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750063104:0@lo:503: 00000100:00100000:2.0:1787784522.900642:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10351:1874627750063232:0@lo:502: 00000100:00100000:2.0:1787784522.900839:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.900891:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784522.901750:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750063232 00000100:00100000:1.0:1787784522.901765:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750063232 00000100:00100000:1.0:1787784522.901876:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787784522.901887:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:10351:x1874627750063232:12345-0@lo:502: 00000100:00100000:1.0:1787784522.902091:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:10351:x1874627750063232:12345-0@lo:502: Request processed in 205us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784522.902100:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787784522.902331:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10351:1874627750063232:0@lo:502: 00000100:00100000:2.0:1787784522.902400:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10351:1874627750063360:0@lo:502: 00000100:00100000:2.0:1787784522.902444:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.902482:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784522.906039:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750063360 00000100:00100000:1.0:1787784522.906066:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750063360 00000100:00100000:1.0:1787784522.906150:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787784522.906162:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:10351:x1874627750063360:12345-0@lo:502: 00000100:00100000:1.0:1787784522.906633:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+16:10351:x1874627750063360:12345-0@lo:502: Request processed in 472us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784522.906642:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787784522.912681:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10351:1874627750063360:0@lo:502: 00000040:00080000:2.0:1787784522.912783:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787784522.913292:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787784522.913324:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787784522.913339:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.913352:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784522.913365:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787784522.913368:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787784522.913372:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787784522.913427:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.913436:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.913467:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784522.913495:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26612c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750063488:0@lo:101: 00000100:00100000:1.0:1787784522.913586:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784522.913644:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784522.913730:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750063488 00000100:00100000:0.0:1787784522.913739:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750063488 00000100:00100000:0.0:1787784522.914316:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787784522.914333:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+16:6518:x1874627750063488:12345-0@lo:101: 00010000:00010000:0.0:1787784522.914352:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784522.914381:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1628200/0x88ace7295d9cd6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cd63 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784522.914413:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1628200/0x88ace7295d9cd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cd63 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784522.914425:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1628200/0x88ace7295d9cd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cd63 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784522.914436:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628200, rc 0) 00000100:00100000:0.0:1787784522.914504:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750063488:12345-0@lo:101: Request processed in 178us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784522.914512:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787784522.915134:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26612c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750063488:0@lo:101: 00010000:00010000:2.0:1787784522.915156:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784522.915167:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784522.915258:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750063616:0@lo:501: 00000100:00100000:2.0:1787784522.915302:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.915330:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784522.915384:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750063616 00000100:00100000:0.0:1787784522.915390:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750063616 00000100:00100000:0.0:1787784522.915429:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787784522.915438:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750063616:12345-0@lo:501: 00000100:00100000:0.0:1787784522.915594:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750063616:12345-0@lo:501: Request processed in 157us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784522.915601:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787784522.915701:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750063616:0@lo:501: 00000100:00100000:2.0:1787784522.915948:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750063744:0@lo:503: 00000100:00100000:2.0:1787784522.916012:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.916041:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784522.916096:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750063744 00000100:00100000:1.0:1787784522.916102:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750063744 00000100:00100000:1.0:1787784522.916129:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787784522.916137:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750063744:12345-0@lo:503: 00000100:00100000:1.0:1787784522.916244:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750063744:12345-0@lo:503: Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784522.916252:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787784522.916335:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750063744:0@lo:503: 00000100:00100000:2.0:1787784522.923003:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10352:1874627750063872:0@lo:502: 00000100:00100000:2.0:1787784522.923127:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.923187:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784522.923575:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750063872 00000100:00100000:0.0:1787784522.923584:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750063872 00000100:00100000:0.0:1787784522.923649:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787784522.923660:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:10352:x1874627750063872:12345-0@lo:502: 00000100:00100000:0.0:1787784522.924007:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:10352:x1874627750063872:12345-0@lo:502: Request processed in 347us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784522.924015:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787784522.924187:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10352:1874627750063872:0@lo:502: 00000020:01000000:2.0:1787784522.924225:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784522.924239:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784522.924241:0:10352:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787784522.924248:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787784522.924278:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10352:1874627750064000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784522.924315:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.924337:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787784522.924384:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750064000 00000100:00100000:0.0:1787784522.924389:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750064000 00000100:00100000:0.0:1787784522.924428:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787784522.924434:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:10352:x1874627750064000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784522.924506:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+17:10352:x1874627750064000:12345-0@lo:502:llog_process_th.0 Request processed in 71us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784522.924513:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787784522.924601:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10352:1874627750064000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784522.924616:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784522.924619:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784522.924621:0:10352:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787784522.924624:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1787784522.924802:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787784522.924827:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787784522.924849:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.924862:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784522.924873:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787784522.924876:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951efedf000 from 48 10000000:01000000:1.0:1787784522.924879:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787784522.924906:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.924914:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.924931:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784522.924944:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750064128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784522.924976:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784522.925002:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784522.925293:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750064128 00000100:00100000:0.0:1787784522.925298:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750064128 00000100:00100000:0.0:1787784522.925370:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787784522.925379:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+17:6518:x1874627750064128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784522.925389:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784522.925406:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cd71 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784522.925435:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cd71 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784522.925447:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cd71 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784522.925457:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628000, rc 0) 00000100:00100000:0.0:1787784522.925497:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750064128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784522.925504:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787784522.925560:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750064128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784522.925572:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.925582:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784522.925638:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750064256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784522.925660:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784522.932226:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784522.932310:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750064256 00000100:00100000:3.0:1787784522.932323:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750064256 00000100:00100000:3.0:1787784522.932390:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787784522.932401:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750064256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784522.932646:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750064256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (6983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784522.932656:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787784522.933309:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750064256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784522.933389:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750064384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784522.933471:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784522.933510:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784522.935229:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750064384 00000100:00100000:3.0:1787784522.935244:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750064384 00000100:00100000:3.0:1787784522.935307:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787784522.935319:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750064384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784522.935593:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750064384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784522.935602:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787784522.948553:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750064384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784522.949267:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2664b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10353:1874627750064512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784522.949368:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784522.949426:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5780 going to sleep for 11 seconds 00000100:00100000:0.0:1787784522.949655:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750064512 00000100:00100000:0.0:1787784522.949664:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750064512 00000100:00100000:0.0:1787784522.949758:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787784522.950203:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:10353:x1874627750064512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784522.950398:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+18:10353:x1874627750064512:12345-0@lo:502:llog_process_th.0 Request processed in 630us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784522.950414:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787784522.950534:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2664b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10353:1874627750064512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784522.950598:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10353:1874627750064640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784522.950662:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784522.950693:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784522.951037:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750064640 00000100:00100000:2.0:1787784522.951045:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750064640 00000100:00100000:2.0:1787784522.951092:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787784522.951102:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+18:10353:x1874627750064640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784522.951200:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+18:10353:x1874627750064640:12345-0@lo:502:llog_process_th.0 Request processed in 100us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784522.951208:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787784522.951416:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10353:1874627750064640:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787784522.951442:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787784522.951644:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787784522.951671:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787784522.951683:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784522.951695:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784522.951705:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787784522.951708:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787784522.951711:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787784522.951755:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784522.951765:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784522.952218:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784522.952240:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750064768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784522.952288:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.952320:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784522.952418:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750064768 00000100:00100000:1.0:1787784522.952424:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750064768 00000100:00100000:1.0:1787784522.952689:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787784522.952700:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+18:6518:x1874627750064768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784522.952712:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784522.952742:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34600/0x88ace7295d9cd86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cd7f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.952803:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34600/0x88ace7295d9cd86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cd7f expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.952816:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34600/0x88ace7295d9cd86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cd7f expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.952827:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34600, rc 0) 00000100:00100000:1.0:1787784522.952878:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750064768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784522.952885:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787784522.953551:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750064768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784522.953570:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784522.953582:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784522.953700:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750064896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784522.953752:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.956376:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784522.959589:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750064896 00000100:00100000:3.0:1787784522.959611:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750064896 00000100:00100000:3.0:1787784522.959704:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787784522.959715:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750064896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784522.968635:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750064896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 8915us (14875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784522.968649:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787784522.969171:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750064896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784522.969247:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750065024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784522.969317:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.969355:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784522.969429:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750065024 00000100:00100000:0.0:1787784522.969438:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750065024 00000100:00100000:0.0:1787784522.969505:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787784522.969516:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750065024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784522.969642:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750065024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784522.969650:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787784522.969819:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750065024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784522.970552:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10354:1874627750065152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784522.970601:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.970645:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784522.970759:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750065152 00000100:00100000:0.0:1787784522.970764:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750065152 00000100:00100000:0.0:1787784522.970829:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787784522.971034:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+19:10354:x1874627750065152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784522.971156:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+19:10354:x1874627750065152:12345-0@lo:502:llog_process_th.0 Request processed in 125us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784522.971233:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10354:1874627750065152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784522.971265:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784522.971276:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784522.971278:0:10354:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787784522.971285:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787784522.971305:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10354:1874627750065280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784522.971339:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.971356:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784522.971404:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750065280 00000100:00100000:3.0:1787784522.971408:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750065280 00000100:00100000:0.0:1787784522.976393:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787784522.977224:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787784522.977249:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+19:10354:x1874627750065280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784522.977504:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+19:10354:x1874627750065280:12345-0@lo:502:llog_process_th.0 Request processed in 266us (6163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784522.977512:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787784522.977639:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10354:1874627750065280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784522.977690:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784522.977700:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784522.977703:0:10354:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787784522.977717:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1787784522.978203:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787784522.978233:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787784522.978248:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.978261:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784522.978273:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787784522.978277:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951cfe95800 from 48 10000000:01000000:3.0:1787784522.978280:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787784522.978321:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.978329:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.978341:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784522.978374:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750065408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784522.978428:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784522.978479:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784522.978559:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750065408 00000100:00100000:1.0:1787784522.978568:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750065408 00000100:00100000:1.0:1787784522.978637:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787784522.978648:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+19:6518:x1874627750065408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784522.978660:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784522.978682:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34200/0x88ace7295d9cd94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cd8d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.978709:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34200/0x88ace7295d9cd94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cd8d expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.978734:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34200/0x88ace7295d9cd94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cd8d expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.978745:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34200, rc 0) 00000100:00100000:1.0:1787784522.978810:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750065408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784522.978817:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787784522.979077:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750065408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784522.979093:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.979104:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784522.979168:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750065536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784522.979197:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784522.979218:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784522.979230:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750065536 00000100:00100000:3.0:1787784522.979234:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750065536 00000100:00100000:3.0:1787784522.979254:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787784522.979260:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750065536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784522.979389:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750065536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784522.979396:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787784522.979424:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750065536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784522.979452:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750065664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784522.979491:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784522.979502:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784522.979517:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750065664 00000100:00100000:3.0:1787784522.979520:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750065664 00000100:00100000:3.0:1787784522.979534:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787784522.979540:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750065664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784522.979612:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750065664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784522.985196:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787784522.985342:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750065664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784522.988970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784522.989114:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727988224 00000100:00100000:0.0:1787784522.989125:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727988224 00000100:00100000:0.0:1787784522.989198:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 226 00000100:00100000:0.0:1787784522.989209:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+8:6181:x1874627727988224:12345-192.168.202.41@tcp:101: 00010000:00010000:0.0:1787784522.989231:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784522.989257:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cd9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e728cc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784522.989296:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cd9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728cc expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784522.989308:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cd9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728cc expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784522.989338:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629a00, rc 0) 00000100:00100000:0.0:1787784522.989420:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6181:x1874627727988224:12345-192.168.202.41@tcp:101: Request processed in 212us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784522.989428:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 226 00000100:00100000:2.0:1787784522.993278:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10355:1874627750065792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784522.993399:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.993455:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784522.993529:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750065792 00000100:00100000:3.0:1787784522.993539:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750065792 00000100:00100000:3.0:1787784522.993590:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787784522.993601:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:10355:x1874627750065792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784522.994001:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:10355:x1874627750065792:12345-0@lo:502:llog_process_th.0 Request processed in 399us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784522.994011:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787784522.994191:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10355:1874627750065792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784522.994251:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10355:1874627750065920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784522.994294:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784522.994324:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784522.994621:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750065920 00000100:00100000:3.0:1787784522.994628:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750065920 00000100:00100000:3.0:1787784522.994673:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787784522.994682:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+20:10355:x1874627750065920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784522.995144:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+20:10355:x1874627750065920:12345-0@lo:502:llog_process_th.0 Request processed in 460us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784522.995154:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787784522.995258:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10355:1874627750065920:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787784522.995290:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:2.0:1787784522.995557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784522.995614:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727988352 00000100:00100000:0.0:1787784522.995621:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727988352 00000100:00100000:0.0:1787784522.995665:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 229 00000100:00100000:0.0:1787784522.995674:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6181:x1874627727988352:12345-192.168.202.41@tcp:501: 00000100:00100000:0.0:1787784522.996224:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6181:x1874627727988352:12345-192.168.202.41@tcp:501: Request processed in 549us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784522.996233:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 229 00000020:01000000:3.0:1787784522.996669:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787784522.996698:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787784522.996711:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.996763:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784522.997204:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787784522.997208:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1787784522.997211:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787784522.997253:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.997262:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.997273:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784522.997301:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750066048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784522.997369:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784522.997462:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784522.999819:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784523.004551:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750066048 00000100:00100000:2.0:1787784523.004574:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750066048 00000100:00100000:2.0:1787784523.004668:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727988480 00000100:00100000:2.0:1787784523.004673:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727988480 00000100:00100000:2.0:1787784523.004699:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787784523.004710:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750066048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784523.004750:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784523.004807:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5a600/0x88ace7295d9cda9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cda2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784523.005045:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 231 00000100:00100000:1.0:1787784523.005057:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6181:x1874627727988480:12345-192.168.202.41@tcp:503: 00000100:00100000:1.0:1787784523.005277:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6181:x1874627727988480:12345-192.168.202.41@tcp:503: Request processed in 222us (5506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784523.005286:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 231 00010000:00010000:3.0:1787784523.005759:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5a600/0x88ace7295d9cda9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cda2 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.005803:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5a600/0x88ace7295d9cda9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cda2 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.005816:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a600, rc 0) 00000100:00100000:3.0:1787784523.005899:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750066048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1190us (8529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784523.005907:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787784523.006120:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750066048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784523.006144:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.006156:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784523.006262:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750066176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784523.006306:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784523.006346:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355180 going to sleep for 11 seconds 00000100:00100000:2.0:1787784523.006422:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750066176 00000100:00100000:2.0:1787784523.006428:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750066176 00000100:00100000:2.0:1787784523.006461:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787784523.006471:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750066176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784523.006610:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750066176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784523.006617:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787784523.006677:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750066176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784523.006710:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750066304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784523.006763:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784523.006806:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355180 going to sleep for 11 seconds 00000100:00100000:2.0:1787784523.006956:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750066304 00000100:00100000:2.0:1787784523.006967:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750066304 00000100:00100000:2.0:1787784523.006983:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787784523.006990:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750066304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784523.007101:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750066304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784523.007109:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787784523.007305:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750066304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784523.008258:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10356:1874627750066432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784523.008323:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784523.008367:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784523.008501:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750066432 00000100:00100000:3.0:1787784523.008507:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750066432 00000100:00100000:3.0:1787784523.008553:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787784523.008565:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:10356:x1874627750066432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784523.008685:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:10356:x1874627750066432:12345-0@lo:502:llog_process_th.0 Request processed in 122us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784523.008693:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787784523.008813:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10356:1874627750066432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784523.008853:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784523.008864:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784523.008866:0:10356:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787784523.008876:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787784523.008899:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10356:1874627750066560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784523.008933:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784523.008954:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784523.009051:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750066560 00000100:00100000:3.0:1787784523.009056:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750066560 00000100:00100000:3.0:1787784523.009088:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787784523.009096:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:10356:x1874627750066560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784523.009161:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:10356:x1874627750066560:12345-0@lo:502:llog_process_th.0 Request processed in 65us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784523.009167:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787784523.009406:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784523.009473:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727988608 00000100:00100000:3.0:1787784523.009478:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727988608 00000100:00100000:3.0:1787784523.009510:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 236 00000100:00100000:3.0:1787784523.009517:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6663:x1874627727988608:12345-192.168.202.41@tcp:502: 00000100:00100000:3.0:1787784523.009608:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6663:x1874627727988608:12345-192.168.202.41@tcp:502: Request processed in 91us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784523.009615:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 236 00000100:00100000:1.0:1787784523.009851:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10356:1874627750066560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784523.009876:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784523.009882:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784523.009884:0:10356:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787784523.009897:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1787784523.010894:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1787784523.010930:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787784523.010943:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.010956:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784523.010982:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787784523.010986:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951d08ed800 from 48 10000000:01000000:3.0:1787784523.010989:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787784523.011030:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.011039:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.011051:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784523.011074:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750066688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784523.011135:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784523.011187:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784523.012346:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750066688 00000100:00100000:1.0:1787784523.012360:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750066688 00000100:00100000:1.0:1787784523.012441:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787784523.012454:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750066688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784523.012475:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784523.012496:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d35600/0x88ace7295d9cdb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cdb0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.012532:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d35600/0x88ace7295d9cdb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cdb0 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.012545:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d35600/0x88ace7295d9cdb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cdb0 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.012556:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35600, rc 0) 00000100:00100000:1.0:1787784523.012647:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750066688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784523.012654:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787784523.012715:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750066688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784523.012752:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.012765:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784523.012853:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784523.012892:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750066816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784523.012929:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784523.012969:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784523.013021:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727988736 00000100:00100000:1.0:1787784523.013025:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727988736 00000100:00100000:1.0:1787784523.013058:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750066816 00000100:00100000:1.0:1787784523.013061:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750066816 00000100:00100000:1.0:1787784523.013076:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 238 00000100:00100000:1.0:1787784523.013082:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6663:x1874627727988736:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784523.013116:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787784523.013126:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750066816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784523.013233:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6663:x1874627727988736:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 148us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784523.013242:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 238 00000100:00100000:3.0:1787784523.013263:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750066816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784523.013272:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787784523.013307:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750066816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784523.013340:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750066944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784523.013382:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784523.013423:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784523.013481:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750066944 00000100:00100000:1.0:1787784523.013492:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750066944 00000100:00100000:1.0:1787784523.013528:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787784523.013537:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750066944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784523.013752:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750066944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 217us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784523.013760:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787784523.013952:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750066944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784523.027404:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784523.027466:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727988864 00000100:00100000:2.0:1787784523.027479:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727988864 00000100:00100000:2.0:1787784523.027555:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 241 00000100:00100000:2.0:1787784523.027566:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6181:x1874627727988864:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784523.027588:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784523.027611:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5aa00/0x88ace7295d9cdbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e728d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.027658:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5aa00/0x88ace7295d9cdbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728d3 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.027672:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5aa00/0x88ace7295d9cdbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728d3 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.027683:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5aa00, rc 0) 00000100:00100000:2.0:1787784523.027762:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6181:x1874627727988864:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 197us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784523.027813:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 241 00000100:00100000:1.0:1787784523.035088:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10357:1874627750067072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784523.035224:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784523.035680:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750067072 00000100:00100000:3.0:1787784523.035690:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750067072 00000100:00100000:3.0:1787784523.035765:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787784523.035811:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:10357:x1874627750067072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784523.035870:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784523.035990:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:10357:x1874627750067072:12345-0@lo:502:llog_process_th.0 Request processed in 181us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784523.035999:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787784523.036152:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10357:1874627750067072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784523.036213:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10357:1874627750067200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784523.036256:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784523.036293:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355840 going to sleep for 11 seconds 00000100:00100000:2.0:1787784523.036533:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750067200 00000100:00100000:2.0:1787784523.036538:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750067200 00000100:00100000:2.0:1787784523.036594:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787784523.036603:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:10357:x1874627750067200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784523.036708:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:10357:x1874627750067200:12345-0@lo:502:llog_process_th.0 Request processed in 106us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784523.036715:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787784523.038186:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10357:1874627750067200:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787784523.038246:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787784523.038620:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787784523.038647:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787784523.038663:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.038677:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784523.038690:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787784523.038693:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1787784523.038696:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787784523.038798:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.038808:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.038820:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784523.038847:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2664b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750067328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784523.038925:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784523.038972:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784523.039084:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750067328 00000100:00100000:2.0:1787784523.039094:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750067328 00000100:00100000:2.0:1787784523.039156:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787784523.039168:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750067328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784523.039184:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784523.039200:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5ae00/0x88ace7295d9cdcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cdc5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.039232:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5ae00/0x88ace7295d9cdcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cdc5 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.039244:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5ae00/0x88ace7295d9cdcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cdc5 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.039254:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5ae00, rc 0) 00000100:00100000:2.0:1787784523.039303:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750067328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784523.039310:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787784523.040121:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2664b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750067328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784523.040144:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.040155:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784523.040241:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750067456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784523.040288:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784523.040331:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784523.040418:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750067456 00000100:00100000:3.0:1787784523.040425:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750067456 00000100:00100000:3.0:1787784523.040475:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787784523.040485:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750067456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784523.041447:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750067456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 958us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784523.041461:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787784523.047933:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784523.048836:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727988992 00000100:00100000:3.0:1787784523.048852:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727988992 00000100:00100000:3.0:1787784523.048955:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 246 00000100:00100000:3.0:1787784523.048969:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6181:x1874627727988992:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784523.049159:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6181:x1874627727988992:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 192us (1242us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784523.049168:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 246 00000100:00100000:2.0:1787784523.052625:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750067456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784523.054261:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750067584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784523.054400:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784523.054468:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784523.054709:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750067584 00000100:00100000:1.0:1787784523.054730:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750067584 00000100:00100000:1.0:1787784523.054839:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787784523.054850:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750067584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784523.055021:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750067584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784523.055031:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787784523.055099:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750067584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784523.057523:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10358:1874627750067712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784523.057844:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784523.058103:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784523.059656:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750067712 00000100:00100000:1.0:1787784523.059674:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750067712 00000100:00100000:1.0:1787784523.059801:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787784523.059814:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:10358:x1874627750067712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784523.060052:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:10358:x1874627750067712:12345-0@lo:502:llog_process_th.0 Request processed in 240us (2209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784523.060062:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787784523.060218:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10358:1874627750067712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784523.060268:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784523.060282:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784523.060285:0:10358:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787784523.060292:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787784523.060337:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10358:1874627750067840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784523.060396:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784523.060446:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784523.061200:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750067840 00000100:00100000:2.0:1787784523.061210:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750067840 00000100:00100000:2.0:1787784523.061276:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787784523.061286:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:10358:x1874627750067840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784523.061460:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:10358:x1874627750067840:12345-0@lo:502:llog_process_th.0 Request processed in 174us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784523.061467:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787784523.062346:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10358:1874627750067840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784523.062396:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784523.062408:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784523.062411:0:10358:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787784523.062416:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787784523.063071:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1787784523.063108:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787784523.063124:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.063137:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784523.063149:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787784523.063153:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8951cfef0000 from 1 10000000:01000000:2.0:1787784523.063156:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787784523.063199:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cdd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.063209:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cdd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.063220:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cdd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784523.063245:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750067968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784523.063327:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784523.063392:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3378780 going to sleep for 11 seconds 00000100:00100000:1.0:1787784523.063988:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750067968 00000100:00100000:1.0:1787784523.063997:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750067968 00000100:00100000:1.0:1787784523.064059:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787784523.064070:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750067968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784523.064087:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784523.064130:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df602600/0x88ace7295d9cdda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cdd3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.064165:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602600/0x88ace7295d9cdda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cdd3 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.064176:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df602600/0x88ace7295d9cdda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cdd3 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.064197:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602600, rc 0) 00000100:00100000:1.0:1787784523.064255:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750067968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784523.064263:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787784523.064354:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750067968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784523.064373:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cdd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdda expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.064385:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cdd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cdda expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784523.064466:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750068096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784523.064505:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784523.064540:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1db7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784523.065105:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750068096 00000100:00100000:3.0:1787784523.065113:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750068096 00000100:00100000:3.0:1787784523.065170:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787784523.065181:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750068096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784523.065298:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750068096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (791us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784523.065307:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787784523.065333:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750068096:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787784523.065384:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787784523.065394:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cdd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdda expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.065405:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cdd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdda expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.270179:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784524.295677:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784524.935169:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784524.935202:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750068224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784524.935293:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784524.935394:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750068224 00000100:00100000:0.0:1787784524.935404:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750068224 00000100:00100000:0.0:1787784524.935472:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784524.935483:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750068224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784524.935525:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787784524.935995:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784524.936596:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750068224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784524.936608:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784524.936654:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750068352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784524.936721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787784524.936799:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff489680 x1874627750068224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784524.936824:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750068224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784524.936861:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750068352 00000100:00100000:0.0:1787784524.936866:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750068352 00000100:00100000:0.0:1787784524.936908:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787784524.936928:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff488780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750068352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784524.936945:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784524.936983:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff488780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750068352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784524.936989:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787784524.937015:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c26661c0 x1874627750068352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784524.937028:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750068352:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787784524.937884:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784524.940038:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750068480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784524.940161:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784524.940267:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750068480 00000100:00100000:0.0:1787784524.940277:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750068480 00000100:00100000:0.0:1787784524.940343:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787784524.940353:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750068480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784524.940396:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787784524.940470:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750068480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784524.940478:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787784524.940538:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750068480:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1787784524.968596:0:10395:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2f7f1ba0 20000000:00000080:0.0:1787784524.968618:0:10395:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8950c23df000 uarg=0000000000000000 20000000:01000000:0.0:1787784524.968661:0:10395:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787784524.968667:0:10395:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787784524.968673:0:10395:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787784524.970005:0:10396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787784524.970542:0:10395:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787784524.976351:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787784524.976473:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787784524.976490:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787784524.976511:0:10395:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787784524.976539:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.976562:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c151e000/0x88ace7295d9ca7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca76 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.976571:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c13ff400/0x88ace7295d9ca8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ca84 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.976578:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c13fee00/0x88ace7295d9cadf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cad8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.976658:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c151fc00/0x88ace7295d9cc05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cbfe expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.976669:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951d1629400/0x88ace7295d9cd1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72894 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.976679:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.977029:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951d1629400/0x88ace7295d9cd1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72894 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.977047:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951d1629400/0x88ace7295d9cd1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72894 expref: 9 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784524.977067:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874627750068608:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784524.977241:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c151fc00/0x88ace7295d9cc05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cbfe expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.977251:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951c151fc00/0x88ace7295d9cc05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cbfe expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784524.977261:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874627750068736:0@lo:104: 00000100:00100000:1.0:1787784524.977317:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784524.977495:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c13fee00/0x88ace7295d9cadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cad8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.977505:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951c13fee00/0x88ace7295d9cadf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cad8 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784524.977515:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2661a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874627750068864:0@lo:104: 00000100:00100000:1.0:1787784524.977543:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784524.977568:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c13ff400/0x88ace7295d9ca8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ca84 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.977576:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951c13ff400/0x88ace7295d9ca8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ca84 expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784524.977608:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874627750068992:0@lo:104: 00010000:00010000:1.0:1787784524.977638:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c151e000/0x88ace7295d9ca7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ca76 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.977645:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951c151e000/0x88ace7295d9ca7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ca76 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784524.977652:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874627750069120:0@lo:104: 00000100:00100000:1.0:1787784524.977668:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784524.978887:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787784524.978925:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784524.978946:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784524.978975:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750068736 00000100:00100000:3.0:1787784524.978984:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750068736 00000100:00100000:3.0:1787784524.979042:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750068864 00000100:00100000:3.0:1787784524.979045:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750068864 00000100:00100000:3.0:1787784524.979056:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750068992 00000100:00100000:3.0:1787784524.979059:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750068992 00000100:00100000:3.0:1787784524.979068:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750069120 00000100:00100000:3.0:1787784524.979070:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750069120 00000100:00100000:3.0:1787784524.979086:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787784524.979349:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26612c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+6:10395:x1874627750068736:12345-0@lo:104: 00010000:00010000:3.0:1787784524.979431:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cc05 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.979528:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784524.979535:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26612c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+6:10395:x1874627750068736:12345-0@lo:104: Request processed in 191us (2218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784524.979544:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787784524.979568:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784524.979574:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5351c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+5:10395:x1874627750068864:12345-0@lo:104: 00010000:00010000:3.0:1787784524.979643:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cadf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.979693:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787784524.979699:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5351c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+5:10395:x1874627750068864:12345-0@lo:104: Request processed in 126us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784524.979717:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784524.979758:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787784524.979764:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2664f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:10395:x1874627750068992:12345-0@lo:104: 00010000:00010000:3.0:1787784524.979812:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca8b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.979855:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787784524.979861:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2664f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:10395:x1874627750068992:12345-0@lo:104: Request processed in 98us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784524.979867:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787784524.979881:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787784524.979887:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10395:x1874627750069120:12345-0@lo:104: 00010000:00010000:3.0:1787784524.979896:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9ca76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca7d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.979924:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787784524.979929:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:10395:x1874627750069120:12345-0@lo:104: Request processed in 43us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784524.979934:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1787784524.979960:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787784524.979968:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cc05 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.979975:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34c00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784524.979980:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cc05 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.979991:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cc05 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784524.979999:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cc05 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784524.980006:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787784524.980058:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc05 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.980066:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784524.980221:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1787784524.980608:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874627750068736:0@lo:104: 00000100:00100000:1.0:1787784524.980621:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2661a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874627750068864:0@lo:104: 00000100:00100000:1.0:1787784524.980629:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874627750068992:0@lo:104: 00000100:00100000:1.0:1787784524.980638:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874627750069120:0@lo:104: 00010000:00010000:3.0:1787784524.980763:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc05 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.980801:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9cbfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cc05 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.980818:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784524.980821:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca8b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.980828:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784524.980832:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ca8b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.980841:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ca8b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784524.980847:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ca8b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784524.980852:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787784524.980891:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca8b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.980898:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784524.980923:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca8b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.980945:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9ca84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca8b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.980956:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784524.980959:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9ca76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ca7d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.980965:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35c00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784524.980968:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9ca76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ca7d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.980974:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9ca76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ca7d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784524.980981:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9ca76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ca7d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784524.980987:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787784524.981003:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9ca76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca7d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.981009:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784524.981015:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9ca76 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca7d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.981023:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9ca76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ca7d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.981035:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784524.981043:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784524.981045:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784524.981066:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750069248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784524.981310:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750069504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784524.981419:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2664b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750069376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784524.981607:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784524.981867:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750069504 00000100:00100000:1.0:1787784524.981876:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750069504 00010000:00010000:1.0:1787784524.981917:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c151e000/0x88ace7295d9ca7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca76 expref: 24 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784524.981959:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787784524.981970:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750069504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784524.981986:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784524.981992:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c151e000/0x88ace7295d9ca7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca76 expref: 24 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.982004:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c151e000/0x88ace7295d9ca7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ca76 expref: 24 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.982036:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c151e000/0x88ace7295d9ca7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ca76 expref: 24 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.982055:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784524.982106:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+23:3645:x1874627750069504:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784524.982113:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787784524.982189:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750069504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784524.982330:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784524.982446:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750069248 00000100:00100000:0.0:1787784524.982451:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750069248 00010000:00010000:0.0:1787784524.982471:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c151fc00/0x88ace7295d9cc05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cbfe expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784524.982505:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787784524.982513:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+23:3647:x1874627750069248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784524.982522:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784524.982526:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c151fc00/0x88ace7295d9cc05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cbfe expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.982536:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c151fc00/0x88ace7295d9cc05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cbfe expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.982547:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c151fc00/0x88ace7295d9cc05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cbfe expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.982557:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784524.982595:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+22:3647:x1874627750069248:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784524.982602:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787784524.982722:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750069248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784524.983255:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784524.983259:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784524.983261:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784524.983334:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cadf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.983344:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628c00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784524.983348:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cadf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.983441:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cadf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784524.983448:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cadf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784524.983453:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784524.983498:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cadf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.983506:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784524.983534:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cadf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.983541:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1628c00/0x88ace7295d9cad8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cadf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.983557:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784524.983559:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784524.983561:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784524.983568:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784524.983578:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750069632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784524.983760:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784524.983885:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750069632 00000100:00100000:1.0:1787784524.983891:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750069632 00010000:00010000:1.0:1787784524.983918:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c13fee00/0x88ace7295d9cadf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cad8 expref: 22 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784524.983950:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784524.983958:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+22:3647:x1874627750069632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784524.983971:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784524.983976:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c13fee00/0x88ace7295d9cadf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cad8 expref: 22 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.983986:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c13fee00/0x88ace7295d9cadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cad8 expref: 22 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.984000:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c13fee00/0x88ace7295d9cadf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cad8 expref: 22 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.984014:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784524.984048:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+21:3647:x1874627750069632:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784524.984055:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784524.985038:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750069632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784524.985326:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784524.985456:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727989120 00000100:00100000:3.0:1787784524.985463:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727989120 00010000:00010000:3.0:1787784524.985497:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951d1629400/0x88ace7295d9cd1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72894 expref: 10 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784524.985535:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:3.0:1787784524.985546:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfebe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2405:x1874627727989120:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784524.985561:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784524.985566:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951d1629400/0x88ace7295d9cd1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72894 expref: 10 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.985589:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951d1629400/0x88ace7295d9cd1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72894 expref: 10 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.985608:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784524.985665:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfebe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2405:x1874627727989120:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 120us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784524.985673:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00010000:00010000:0.0:1787784524.986280:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629400/0x88ace7295d9cd1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72894 expref: 9 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784524.986300:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874627750068608:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784524.986359:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784524.986682:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784524.986819:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750069376 00000100:00100000:1.0:1787784524.986825:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750069376 00010000:00010000:1.0:1787784524.986854:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c13ff400/0x88ace7295d9ca8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca84 expref: 21 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784524.986882:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784524.986891:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+21:3644:x1874627750069376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784524.986902:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784524.986906:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c13ff400/0x88ace7295d9ca8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ca84 expref: 21 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.986916:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c13ff400/0x88ace7295d9ca8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ca84 expref: 21 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.986932:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c13ff400/0x88ace7295d9ca8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ca84 expref: 21 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.986946:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.986956:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.986974:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.986981:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.986989:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.987011:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.987018:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784524.987023:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.987033:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.987055:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.987065:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784524.987196:0:10395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.987205:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.987213:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df603e00/0x88ace7295d9cde1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784524.988565:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+20:3644:x1874627750069376:12345-0@lo:103:ldlm_bl.0 Request processed in 1664us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784524.988587:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784524.988650:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2664b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750069376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784525.318043:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784525.446062:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787784525.446107:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2666580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750069760:0@lo:400:kworker.0 00000100:00100000:1.0:1787784525.446229:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784525.446315:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750069888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784525.446346:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784525.446374:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750070272:0@lo:400:kworker.0 00000100:00100000:3.0:1787784525.446383:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750069760 00000100:00100000:1.0:1787784525.446397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784525.446416:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750070784:0@lo:400:kworker.0 00000100:00100000:1.0:1787784525.446453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784525.446475:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787784525.446481:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750070400:0@lo:400:kworker.0 00000100:00100000:1.0:1787784525.446504:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784525.446522:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750070912:0@lo:400:kworker.0 00000100:00100000:1.0:1787784525.446543:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784525.446572:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2667840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750070016:0@lo:400:kworker.0 00000100:00100000:3.0:1787784525.446603:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750069760 00000100:00100000:3.0:1787784525.446657:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750070272 00000100:00100000:3.0:1787784525.446660:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750070272 00000100:00100000:3.0:1787784525.446686:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750070400 00000100:00100000:3.0:1787784525.446688:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750070400 00000100:00100000:0.0:1787784525.446718:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2665680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750070144:0@lo:400:kworker.0 00000100:00100000:3.0:1787784525.446722:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787784525.446733:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750069760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784525.446759:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784525.446801:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2664b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750070656:0@lo:400:kworker.0 00000100:00100000:0.0:1787784525.446829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784525.446842:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784525.446847:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750071040:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787784525.446863:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784525.446868:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784525.446873:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784525.446896:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750070784 00000100:00100000:0.0:1787784525.446897:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750069888 00000100:00100000:2.0:1787784525.446900:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750070784 00000100:00100000:0.0:1787784525.446900:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750069888 00000100:00100000:0.0:1787784525.446926:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750071040 00000100:00100000:0.0:1787784525.446928:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750071040 00000100:00100000:2.0:1787784525.446930:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750070912 00000100:00100000:2.0:1787784525.446932:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750070912 00000100:00100000:2.0:1787784525.446947:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784525.446949:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787784525.446954:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874627750070784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784525.446954:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1874627750069888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787784525.446985:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784525.447009:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874627750070784:12345-0@lo:400:kworker.0 Request processed in 55us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784525.447016:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1874627750069888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784525.447017:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784525.447021:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787784525.447035:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784525.447035:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787784525.447042:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750070912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784525.447042:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874627750071040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784525.447052:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784525.447074:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750070912:12345-0@lo:400:kworker.0 Request processed in 34us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784525.447075:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874627750071040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784525.447081:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787784525.447082:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784525.447102:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750070144 00000100:00080000:2.0:1787784525.447104:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784525.447106:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750070144 00000100:00100000:0.0:1787784525.447120:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750070656 00000100:00100000:0.0:1787784525.447122:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750070656 00010000:00080000:2.0:1787784525.447135:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c26630c0 x1874627750070912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784525.447140:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787784525.447146:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750070272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784525.447152:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750070912:0@lo:400:kworker.0 00010000:00080000:2.0:1787784525.447163:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2660f00 x1874627750070784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784525.447172:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750070784:0@lo:400:kworker.0 00000100:00100000:0.0:1787784525.447175:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750070272:12345-0@lo:400:kworker.0 Request processed in 30us (778us total) trans 0 rc 0/0 00010000:00080000:2.0:1787784525.447181:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53c8b40 x1874627750069888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784525.447182:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787784525.447193:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787784525.447194:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750069888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784525.447198:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750070400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784525.447224:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750070400:12345-0@lo:400:kworker.0 Request processed in 25us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784525.447230:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787784525.447241:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787784525.447247:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750070144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784525.447273:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750070144:12345-0@lo:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784525.447280:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787784525.447290:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787784525.447296:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750070656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784525.447322:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750070656:12345-0@lo:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784525.447328:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787784525.447341:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750069760:12345-0@lo:400:kworker.0 Request processed in 610us (1114us total) trans 0 rc 0/0 00000100:00080000:0.0:1787784525.447345:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784525.447348:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1787784525.447359:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48b480 x1874627750071040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784525.447383:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750071040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784525.447395:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2665680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750070144:0@lo:400:kworker.0 00010000:00080000:0.0:1787784525.447404:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2664b40 x1874627750070656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784525.447413:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2664b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750070656:0@lo:400:kworker.0 00000100:00100000:1.0:1787784525.447697:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784525.447738:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750070528:0@lo:400:kworker.0 00000100:00100000:1.0:1787784525.447760:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784525.447904:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750070272:0@lo:400:kworker.0 00000100:00100000:2.0:1787784525.447921:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2666580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750069760:0@lo:400:kworker.0 00010000:00080000:2.0:1787784525.447937:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2667c00 x1874627750070400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784525.447946:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750070400:0@lo:400:kworker.0 00000100:00100000:0.0:1787784525.448404:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750070016 00000100:00100000:0.0:1787784525.448412:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750070016 00000100:00100000:0.0:1787784525.448462:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787784525.448472:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750070016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784525.448532:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750070016:12345-0@lo:400:kworker.0 Request processed in 62us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784525.448541:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787784525.448561:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750070528 00000100:00100000:0.0:1787784525.448565:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750070528 00000100:00100000:1.0:1787784525.448881:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2667840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750070016:0@lo:400:kworker.0 00000100:00100000:0.0:1787784525.449020:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787784525.449029:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750070528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784525.449068:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750070528:12345-0@lo:400:kworker.0 Request processed in 41us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784525.449075:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787784525.449148:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750070528:0@lo:400:kworker.0 00000100:00080000:2.0:1787784525.449193:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784526.052306:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784526.052393:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727989248 00000100:00100000:1.0:1787784526.052407:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727989248 00000100:00100000:1.0:1787784526.052486:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 252 00000100:00100000:1.0:1787784526.052499:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+9:6181:x1874627727989248:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784526.052535:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784526.052561:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df603c00/0x88ace7295d9cde8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e728da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.052599:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603c00/0x88ace7295d9cde8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728da expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.052612:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df603c00/0x88ace7295d9cde8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728da expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.052640:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603c00, rc 0) 00000100:00100000:1.0:1787784526.052737:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6181:x1874627727989248:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 240us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784526.052746:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 252 00000100:00100000:1.0:1787784526.057339:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784526.057429:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727989376 00000100:00100000:0.0:1787784526.057443:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727989376 00000100:00100000:0.0:1787784526.057525:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 253 00000100:00100000:0.0:1787784526.057538:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6181:x1874627727989376:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784526.057804:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6181:x1874627727989376:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 267us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784526.057814:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 253 00000100:00100000:0.0:1787784526.061309:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784526.061494:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727989504 00000100:00100000:3.0:1787784526.061583:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727989504 00000100:00100000:3.0:1787784526.061657:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 254 00000100:00100000:3.0:1787784526.061668:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6181:x1874627727989504:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784526.061917:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6181:x1874627727989504:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 249us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784526.061927:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 254 00000100:00100000:3.0:1787784526.068792:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784526.069323:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727989632 00000100:00100000:1.0:1787784526.069338:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727989632 00000100:00100000:1.0:1787784526.069420:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 255 00000100:00100000:1.0:1787784526.069432:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6720:x1874627727989632:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784526.069649:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6720:x1874627727989632:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 218us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784526.069658:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 255 00000100:00100000:3.0:1787784526.076130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784526.076245:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727989760 00000100:00100000:0.0:1787784526.076266:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727989760 00000100:00100000:0.0:1787784526.076360:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 256 00000100:00100000:0.0:1787784526.076374:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfeea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6720:x1874627727989760:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784526.076616:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfeea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:6720:x1874627727989760:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 244us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784526.076625:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 256 00000100:00100000:0.0:1787784526.110321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784526.110382:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784526.110467:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727989888 00000100:00100000:1.0:1787784526.110479:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727989888 00000100:00100000:1.0:1787784526.110563:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727990016 00000100:00100000:1.0:1787784526.110566:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727990016 00000100:00100000:1.0:1787784526.110591:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:1.0:1787784526.110601:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727989888:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784526.110713:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727989888:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 113us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784526.110721:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:1.0:1787784526.110739:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00100000:1.0:1787784526.110744:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff488f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627727990016:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784526.110800:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff488f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627727990016:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 55us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784526.110830:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00080000:2.0:1787784526.111057:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784526.111064:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784526.113520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784526.113632:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727990144 00000100:00100000:2.0:1787784526.113645:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727990144 00000100:00100000:2.0:1787784526.113762:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:2.0:1787784526.113818:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627727990144:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784526.113912:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627727990144:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 98us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784526.113920:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00080000:0.0:1787784526.114308:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784526.115498:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784526.116018:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727990272 00000100:00100000:2.0:1787784526.116029:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727990272 00000100:00100000:2.0:1787784526.116101:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:2.0:1787784526.116110:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627727990272:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784526.116188:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627727990272:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 79us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784526.116195:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00080000:0.0:1787784526.116273:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787784526.351828:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787784526.661892:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787784526.661904:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951f53b5800 from 4 10000000:01000000:1.0:1787784526.661911:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787784526.661972:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.661987:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.662001:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784526.662034:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750071168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784526.662131:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784526.662210:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784526.662278:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750071168 00000100:00100000:0.0:1787784526.662288:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750071168 00000100:00100000:0.0:1787784526.662357:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787784526.662370:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfeeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750071168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784526.662388:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784526.662406:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1628800/0x88ace7295d9cdf6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cdef expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.662436:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1628800/0x88ace7295d9cdf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cdef expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.662466:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1628800/0x88ace7295d9cdf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cdef expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.662489:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628800, rc 0) 00000100:00100000:0.0:1787784526.662554:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfeeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750071168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784526.662561:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787784526.662627:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750071168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784526.662644:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdf6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.662654:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cdf6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784526.662736:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750071296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784526.662763:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784526.662809:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787784526.662822:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750071296 00000100:00100000:0.0:1787784526.662827:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750071296 00000100:00100000:0.0:1787784526.662850:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787784526.662857:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750071296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784526.662979:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750071296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784526.662987:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787784526.663018:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750071296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784526.663058:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750071424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784526.663103:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784526.663117:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787784526.663128:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750071424 00000100:00100000:0.0:1787784526.663132:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750071424 00000100:00100000:0.0:1787784526.663152:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787784526.663158:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750071424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784526.663243:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750071424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784526.663250:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787784526.663288:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750071424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784526.663498:0:10464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10464:1874627750071552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784526.663531:0:10464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784526.663550:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750071552 00000100:00100000:0.0:1787784526.663553:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750071552 00000100:00100000:0.0:1787784526.663574:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787784526.663580:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:10464:x1874627750071552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784526.663650:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:10464:x1874627750071552:12345-0@lo:502:llog_process_th.0 Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784526.663657:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787784526.663685:0:10464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784526.663710:0:10464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10464:1874627750071552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787784526.663732:0:10464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784526.663744:0:10464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784526.663752:0:10464:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787784526.663761:0:10464:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951f53b5800 00000020:00000080:0.0:1787784526.663763:0:10464:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787784526.666955:0:10464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10464:1874627750071680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784526.667088:0:10464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784526.667150:0:10464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9780 going to sleep for 11 seconds 00000100:00100000:2.0:1787784526.667234:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750071680 00000100:00100000:2.0:1787784526.667243:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750071680 00000100:00100000:2.0:1787784526.667312:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787784526.667324:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:10464:x1874627750071680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784526.667609:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:10464:x1874627750071680:12345-0@lo:502:llog_process_th.0 Request processed in 286us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784526.667722:0:10464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10464:1874627750071680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784526.667764:0:10464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784526.667798:0:10464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784526.667801:0:10464:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787784526.667810:0:10464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:2.0:1787784526.668035:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:01000000:1.0:1787784526.668843:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787784526.668881:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787784526.668897:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdf6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.668920:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdf6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784526.668934:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787784526.668937:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951efedf000 from 4 10000000:01000000:1.0:1787784526.668941:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787784526.668985:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.668994:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.669005:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784526.669031:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750071808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784526.669100:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784526.669140:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9780 going to sleep for 11 seconds 00000100:00100000:2.0:1787784526.669216:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750071808 00000100:00100000:2.0:1787784526.669223:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750071808 00000100:00100000:2.0:1787784526.669280:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787784526.669291:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750071808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784526.669307:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784526.669324:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5be00/0x88ace7295d9ce04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cdfd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.669366:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5be00/0x88ace7295d9ce04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cdfd expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.669378:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5be00/0x88ace7295d9ce04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cdfd expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.669388:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5be00, rc 0) 00000100:00100000:2.0:1787784526.669438:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750071808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784526.669445:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787784526.669711:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750071808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784526.669727:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce04 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.669738:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ce04 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784526.669844:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750071936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.669878:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784526.669895:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3378480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784526.669911:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750071936 00000100:00100000:2.0:1787784526.669915:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750071936 00000100:00100000:2.0:1787784526.669944:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787784526.669952:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750071936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.670101:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750071936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784526.670122:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787784526.670155:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750071936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.670185:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750072064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.670228:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784526.670242:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3378480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784526.670253:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750072064 00000100:00100000:2.0:1787784526.670256:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750072064 00000100:00100000:2.0:1787784526.670276:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787784526.670282:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750072064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.670363:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750072064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784526.670370:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787784526.670412:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750072064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.674881:0:10466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10466:1874627750072192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784526.675002:0:10466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784526.675069:0:10466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3378900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784526.675301:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750072192 00000100:00100000:0.0:1787784526.675311:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750072192 00000100:00100000:0.0:1787784526.675378:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787784526.675391:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:10466:x1874627750072192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784526.675576:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:10466:x1874627750072192:12345-0@lo:502:llog_process_th.0 Request processed in 188us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784526.675584:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787784526.676806:0:10466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10466:1874627750072192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784526.676857:0:10466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784526.676870:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784526.676873:0:10466:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787784526.676882:0:10466:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951efedf000 00000020:00000080:2.0:1787784526.676885:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787784526.676993:0:10466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10466:1874627750072320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784526.677063:0:10466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784526.677117:0:10466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3378900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784526.678332:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750072320 00000100:00100000:1.0:1787784526.678344:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750072320 00000100:00100000:1.0:1787784526.678524:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787784526.678537:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:10466:x1874627750072320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784526.678764:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:10466:x1874627750072320:12345-0@lo:502:llog_process_th.0 Request processed in 228us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784526.678797:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787784526.678971:0:10466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10466:1874627750072320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784526.679008:0:10466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784526.679020:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784526.679023:0:10466:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787784526.679029:0:10466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787784526.679287:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787784526.679313:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784526.679327:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce04 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.679340:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce04 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784526.679353:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787784526.679356:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951cfe95800 from 4 10000000:01000000:2.0:1787784526.679358:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784526.679399:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.679409:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.679419:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784526.679445:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750072448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.679495:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784526.679533:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3378900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784526.679551:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750072448 00000100:00100000:2.0:1787784526.679557:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750072448 00000100:00100000:2.0:1787784526.679591:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787784526.679599:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750072448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784526.679752:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784526.679793:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5ba00/0x88ace7295d9ce12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ce0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.679833:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5ba00/0x88ace7295d9ce12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ce0b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.679845:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5ba00/0x88ace7295d9ce12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ce0b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.679856:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5ba00, rc 0) 00000100:00100000:2.0:1787784526.679890:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750072448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 292us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784526.679897:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787784526.679934:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750072448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784526.679947:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce12 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.679957:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ce12 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784526.680015:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750072576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.680043:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784526.680057:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3378900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784526.680069:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750072576 00000100:00100000:2.0:1787784526.680073:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750072576 00000100:00100000:2.0:1787784526.680094:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787784526.680100:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750072576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.680216:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750072576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784526.680233:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787784526.680265:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750072576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.680299:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750072704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.680339:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784526.680353:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d2148f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784526.680365:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750072704 00000100:00100000:2.0:1787784526.680368:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750072704 00000100:00100000:2.0:1787784526.680388:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787784526.680394:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750072704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.680485:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750072704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784526.680493:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787784526.680533:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750072704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784526.697904:0:10467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10467:1874627750072832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784526.698026:0:10467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784526.698090:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750072832 00000100:00100000:1.0:1787784526.698098:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750072832 00000100:00100000:1.0:1787784526.698162:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787784526.698172:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:10467:x1874627750072832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784526.698313:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:10467:x1874627750072832:12345-0@lo:502:llog_process_th.0 Request processed in 141us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784526.698321:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787784526.698383:0:10467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787784526.698410:0:10467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10467:1874627750072832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784526.698447:0:10467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784526.698460:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784526.698463:0:10467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787784526.700762:0:10467:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951cfe95800 00000020:00000080:1.0:1787784526.700788:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787784526.700966:0:10467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10467:1874627750072960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784526.701069:0:10467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784526.701125:0:10467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9780 going to sleep for 11 seconds 00000100:00100000:0.0:1787784526.702929:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750072960 00000100:00100000:0.0:1787784526.702947:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750072960 00000100:00100000:0.0:1787784526.703065:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787784526.703078:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:10467:x1874627750072960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784526.703292:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:10467:x1874627750072960:12345-0@lo:502:llog_process_th.0 Request processed in 216us (2223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784526.703300:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787784526.708933:0:10467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10467:1874627750072960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784526.708995:0:10467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784526.709007:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784526.709011:0:10467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787784526.709019:0:10467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787784526.709820:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787784526.709854:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784526.709870:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce12 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.709885:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce12 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784526.709900:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787784526.709903:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951d08ed800 from 4 10000000:01000000:2.0:1787784526.709907:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784526.709954:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.709979:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784526.709991:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784526.710019:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750073088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.710107:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784526.710161:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3378480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784526.710252:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750073088 00000100:00100000:1.0:1787784526.710260:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750073088 00000100:00100000:1.0:1787784526.710319:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787784526.710330:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750073088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784526.710346:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784526.710367:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df602a00/0x88ace7295d9ce20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ce19 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.710397:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602a00/0x88ace7295d9ce20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ce19 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.710409:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df602a00/0x88ace7295d9ce20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ce19 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.710418:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602a00, rc 0) 00000100:00100000:1.0:1787784526.711559:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750073088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784526.711575:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787784526.711873:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750073088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784526.711896:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.711909:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ce20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784526.711993:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750073216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784526.712049:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784526.712095:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784526.712292:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750073216 00000100:00100000:2.0:1787784526.712301:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750073216 00000100:00100000:2.0:1787784526.712349:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787784526.712359:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750073216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.712749:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750073216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784526.712757:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787784526.712909:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750073216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784526.712952:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750073344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784526.713009:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784526.713085:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784526.714350:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750073344 00000100:00100000:2.0:1787784526.714363:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750073344 00000100:00100000:2.0:1787784526.715947:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787784526.715970:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750073344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.716200:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750073344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (3189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784526.716209:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787784526.716405:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750073344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784526.717306:0:10469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10469:1874627750073472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784526.717395:0:10469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784526.717448:0:10469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81de300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784526.717572:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750073472 00000100:00100000:3.0:1787784526.717581:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750073472 00000100:00100000:3.0:1787784526.717644:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787784526.717655:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:10469:x1874627750073472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784526.717985:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:10469:x1874627750073472:12345-0@lo:502:llog_process_th.0 Request processed in 331us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784526.717995:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787784526.718090:0:10469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10469:1874627750073472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784526.718122:0:10469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784526.718134:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784526.718137:0:10469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787784526.718146:0:10469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951d08ed800 00000020:00000080:2.0:1787784526.718149:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787784526.718231:0:10469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10469:1874627750073600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784526.718270:0:10469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784526.718304:0:10469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81de300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784526.718356:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750073600 00000100:00100000:3.0:1787784526.718361:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750073600 00000100:00100000:3.0:1787784526.718398:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787784526.718405:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:10469:x1874627750073600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784526.718607:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:10469:x1874627750073600:12345-0@lo:502:llog_process_th.0 Request processed in 201us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784526.718711:0:10469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:10469:1874627750073600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784526.718730:0:10469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784526.718735:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784526.718737:0:10469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787784526.718741:0:10469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:3.0:1787784526.719021:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000020:01000000:3.0:1787784526.719061:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787784526.719088:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784526.719100:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784526.719112:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784526.982137:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750073728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784526.982238:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784526.983724:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750073728 00000100:00100000:3.0:1787784526.983742:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750073728 00000100:00100000:3.0:1787784526.983834:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787784526.983845:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750073728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784526.983896:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787784526.985130:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750073728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1280us (2886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784526.985144:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787784526.987982:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750073728:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784527.366489:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784528.390094:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784529.415160:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784530.054002:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784530.054054:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2666580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750073856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784530.054163:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784530.054279:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750073856 00000100:00100000:0.0:1787784530.054289:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750073856 00000100:00100000:1.0:1787784530.054557:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750073984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784530.054597:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784530.054631:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750073984 00000100:00100000:1.0:1787784530.054635:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750073984 00000100:00100000:2.0:1787784530.055003:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784530.055016:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750074112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784530.055066:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784530.055125:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750074112 00000100:00100000:2.0:1787784530.055129:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750074112 00000100:00100000:2.0:1787784530.055183:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787784530.055194:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750074112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784530.055251:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787784530.055534:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787784530.055544:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750073856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784530.055569:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787784530.063489:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784530.063627:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750074112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784530.065575:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750073856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10019us (11399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784530.065616:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787784530.065678:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787784530.065696:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750073984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784530.065735:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784530.065811:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750073984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (11214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784530.065818:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787784530.066220:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48c000 x1874627750073984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784530.066249:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750073984:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787784530.066282:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2666580 x1874627750073856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784530.066297:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2666580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750073856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784530.068642:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750074112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 13436us (13562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784530.068672:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:0.0:1787784530.438040:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784530.566304:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750074368:0@lo:400:kworker.0 00000100:00100000:3.0:1787784530.566444:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784530.566515:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750074880:0@lo:400:kworker.0 00000100:00100000:3.0:1787784530.566539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784530.566562:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9d70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750075392:0@lo:400:kworker.0 00000100:00100000:3.0:1787784530.566592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784530.566626:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787784530.566632:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750074496:0@lo:400:kworker.0 00000100:00100000:3.0:1787784530.566669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784530.566689:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750075008:0@lo:400:kworker.0 00000100:00100000:3.0:1787784530.566712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784530.566757:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750074368 00000100:00100000:3.0:1787784530.566797:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750074368 00000100:00100000:3.0:1787784530.566848:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750074880 00000100:00100000:3.0:1787784530.566851:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750074880 00000100:00100000:3.0:1787784530.566876:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750075008 00000100:00100000:3.0:1787784530.566878:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750075008 00000100:00100000:3.0:1787784530.566896:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787784530.566905:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750074368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784530.566968:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750074368:12345-0@lo:400:kworker.0 Request processed in 63us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784530.566977:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787784530.566994:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787784530.567001:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750074880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784530.567028:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750074880:12345-0@lo:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784530.567045:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787784530.567056:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787784530.567062:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750075008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784530.567089:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750075008:12345-0@lo:400:kworker.0 Request processed in 27us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784530.567095:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787784530.567121:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750075392 00000100:00100000:3.0:1787784530.567124:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750075392 00000100:00100000:3.0:1787784530.567152:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784530.567159:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750075392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784530.567190:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750075392:12345-0@lo:400:kworker.0 Request processed in 32us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784530.567196:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784530.567244:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750075008:0@lo:400:kworker.0 00000100:00100000:3.0:1787784530.567257:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750074368:0@lo:400:kworker.0 00010000:00080000:3.0:1787784530.567269:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2608f00 x1874627750074880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784530.567279:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750074880:0@lo:400:kworker.0 00010000:00080000:3.0:1787784530.567288:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d9d70780 x1874627750075392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784530.567296:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9d70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750075392:0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.567498:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750074240:0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.567543:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784530.567576:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750074752:0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.567600:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784530.567618:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750075264:0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.567640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784530.567675:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787784530.567682:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750074624:0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.567708:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784530.567724:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c260a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750075136:0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.567746:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784530.567795:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750074752 00000100:00100000:0.0:1787784530.567799:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750074752 00000100:00100000:0.0:1787784530.567824:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750074624 00000100:00100000:0.0:1787784530.567827:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750074624 00000100:00100000:0.0:1787784530.567839:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750075136 00000100:00100000:0.0:1787784530.567841:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750075136 00000100:00100000:0.0:1787784530.567855:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787784530.567872:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2664b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750074752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.567909:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2664b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750074752:12345-0@lo:400:kworker.0 Request processed in 37us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784530.567916:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787784530.567929:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787784530.567935:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2666580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750074624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.567960:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2666580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750074624:12345-0@lo:400:kworker.0 Request processed in 25us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784530.567966:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787784530.567978:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787784530.567984:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2667840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750075136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.568009:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2667840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750075136:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784530.568014:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787784530.568033:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750074240 00000100:00100000:0.0:1787784530.568037:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750074240 00000100:00100000:0.0:1787784530.568065:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787784530.568073:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750074240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.568103:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750074240:12345-0@lo:400:kworker.0 Request processed in 31us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784530.568108:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787784530.568137:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750075264 00000100:00100000:0.0:1787784530.568141:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750075264 00000100:00100000:0.0:1787784530.568167:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787784530.568175:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2665680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750075264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.568204:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2665680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750075264:12345-0@lo:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784530.568217:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787784530.568262:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750074624:0@lo:400:kworker.0 00010000:00080000:0.0:1787784530.568275:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c260a1c0 x1874627750075136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784530.568285:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c260a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750075136:0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.568295:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750074240:0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.568305:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750074752:0@lo:400:kworker.0 00010000:00080000:0.0:1787784530.568332:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2609a40 x1874627750075264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784530.568342:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750075264:0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.568879:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750074496 00000100:00100000:0.0:1787784530.568887:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750074496 00000100:00100000:0.0:1787784530.568927:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787784530.568936:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750074496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784530.568989:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750074496:12345-0@lo:400:kworker.0 Request processed in 54us (2319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784530.568996:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787784530.569755:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750074496:0@lo:400:kworker.0 00000100:00100000:3.0:1787784530.569802:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784530.569827:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750075520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784530.569879:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784530.569928:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750075520 00000100:00100000:3.0:1787784530.569933:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750075520 00000100:00100000:3.0:1787784530.569972:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787784530.569981:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750075520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784530.570404:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784530.570469:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750075520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 488us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784530.570477:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787784530.572228:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36d3c00 x1874627750075520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784530.572263:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750075520:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787784530.573166:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784530.573177:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784530.573201:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787784530.588200:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784530.588234:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750075648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784530.588349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784530.588421:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750075648 00000100:00100000:1.0:1787784530.588430:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750075648 00000100:00100000:1.0:1787784530.588496:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787784530.588507:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750075648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787784530.588539:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784530.588591:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750075648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784530.588600:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787784530.588648:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48c000 x1874627750075648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784530.588707:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750075648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784531.232424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784531.232474:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784531.232509:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784531.232536:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784531.232566:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784531.232599:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727990912 00000100:00100000:1.0:1787784531.232609:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727990912 00000100:00100000:1.0:1787784531.232694:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727990784 00000100:00100000:1.0:1787784531.232698:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727990784 00000100:00100000:1.0:1787784531.232728:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1787784531.232741:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627727990912:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784531.232866:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627727990912:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 127us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784531.232874:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1787784531.232910:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:1.0:1787784531.232917:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627727990784:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784531.232945:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627727990784:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784531.232952:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:3.0:1787784531.233466:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727990656 00000100:00100000:3.0:1787784531.233472:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727990656 00000100:00100000:3.0:1787784531.233528:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727990528 00000100:00100000:3.0:1787784531.233531:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727990528 00000100:00100000:3.0:1787784531.233555:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 86 00000100:00100000:3.0:1787784531.233563:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627727990656:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784531.233606:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627727990656:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 44us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784531.233612:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 86 00000100:00100000:3.0:1787784531.233625:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00100000:3.0:1787784531.233630:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627727990528:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784531.233664:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627727990528:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 33us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784531.233669:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00100000:2.0:1787784531.233838:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727990400 00000100:00100000:2.0:1787784531.233843:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727990400 00000100:00100000:2.0:1787784531.233890:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 278 00000100:00100000:2.0:1787784531.233898:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2406:x1874627727990400:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784531.233931:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2406:x1874627727990400:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 35us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784531.233938:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 278 00000100:00080000:1.0:1787784531.235951:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784531.235965:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784531.235969:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787784531.235973:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787784531.474822:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784532.105634:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750075776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784532.105763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784532.105928:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750075776 00000100:00100000:0.0:1787784532.105939:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750075776 00000100:00100000:0.0:1787784532.106030:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787784532.106050:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750075776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784532.106101:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784532.106168:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750075776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784532.106176:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787784532.106230:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750075776:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787784532.487133:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787784533.368414:0:10696:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787784533.512247:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784534.535065:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784535.177569:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750075904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784535.177641:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750076160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784535.177692:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784535.177699:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784535.178153:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750076032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787784535.178282:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750075904 00000100:00100000:1.0:1787784535.178291:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750075904 00000100:00100000:1.0:1787784535.178363:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787784535.178374:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff476d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750075904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784535.178413:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784535.181062:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750076160 00000100:00100000:3.0:1787784535.181084:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750076160 00000100:00100000:3.0:1787784535.181170:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787784535.181182:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750076160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787784535.181231:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787784535.183694:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750076160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2500us (5987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784535.183714:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787784535.184000:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750076160:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1787784535.184080:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784535.186912:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784535.187037:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787784535.187048:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1787784535.187960:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750076032 00000100:00100000:3.0:1787784535.187974:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750076032 00000100:00080000:3.0:1787784535.188046:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784535.188218:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787784535.188231:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750076032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784535.188335:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784535.188660:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750076032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 431us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784535.188669:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787784535.189000:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff476d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750075904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10624us (11298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784535.189011:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787784535.189051:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48de00 x1874627750075904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784535.189084:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750075904:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787784535.189210:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36d12c0 x1874627750076032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784535.189226:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750076032:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787784535.561999:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784535.687885:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750076288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784535.687992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784535.688623:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750076288 00000100:00100000:0.0:1787784535.688650:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750076288 00000100:00100000:0.0:1787784535.688735:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787784535.688747:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff475a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750076288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787784535.688823:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784535.688897:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff475a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750076288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 152us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784535.688905:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787784535.688957:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2667c00 x1874627750076288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784535.688979:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750076288:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787784535.689050:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784535.692197:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750076416:0@lo:400:kworker.0 00000100:00100000:2.0:1787784535.692686:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750076672:0@lo:400:kworker.0 00000100:00100000:2.0:1787784535.692755:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784535.692823:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750077184:0@lo:400:kworker.0 00000100:00100000:2.0:1787784535.692853:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784535.692906:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787784535.692913:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750076800:0@lo:400:kworker.0 00000100:00100000:2.0:1787784535.692937:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784535.692957:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750077312:0@lo:400:kworker.0 00000100:00100000:2.0:1787784535.692978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784535.693012:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750077184 00000100:00100000:2.0:1787784535.693022:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750077184 00000100:00100000:2.0:1787784535.693114:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750076800 00000100:00100000:2.0:1787784535.693117:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750076800 00000100:00100000:2.0:1787784535.693131:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750077312 00000100:00100000:2.0:1787784535.693134:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750077312 00000100:00100000:2.0:1787784535.693152:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787784535.693161:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750077184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784535.693234:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750077184:12345-0@lo:400:kworker.0 Request processed in 72us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784535.693242:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787784535.694059:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750076672 00000100:00100000:3.0:1787784535.694069:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750076672 00000100:00100000:3.0:1787784535.694123:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787784535.694134:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750076672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784535.694195:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750076672:12345-0@lo:400:kworker.0 Request processed in 65us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784535.694202:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787784535.694674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784535.694728:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750076928:0@lo:400:kworker.0 00000100:00100000:0.0:1787784535.694788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784535.694806:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750077440:0@lo:400:kworker.0 00000100:00100000:0.0:1787784535.694831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784535.694860:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787784535.694867:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750076544:0@lo:400:kworker.0 00000100:00100000:0.0:1787784535.694888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784535.694899:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750077056:0@lo:400:kworker.0 00000100:00100000:0.0:1787784535.694918:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784535.694927:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750077568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784535.694977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784535.695022:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750076416 00000100:00100000:0.0:1787784535.695027:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750076416 00000100:00100000:0.0:1787784535.695079:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787784535.695087:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750076416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784535.695135:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750076416:12345-0@lo:400:kworker.0 Request processed in 49us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784535.695142:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787784535.695177:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750077440 00000100:00100000:0.0:1787784535.695181:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750077440 00000100:00100000:0.0:1787784535.695218:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784535.695225:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750077440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784535.695258:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750077440:12345-0@lo:400:kworker.0 Request processed in 34us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784535.697308:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750076928 00000100:00100000:2.0:1787784535.697330:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750076928 00000100:00100000:2.0:1787784535.697385:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750076544 00000100:00100000:2.0:1787784535.697389:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750076544 00000100:00100000:2.0:1787784535.697402:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750077056 00000100:00100000:2.0:1787784535.697405:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750077056 00000100:00100000:2.0:1787784535.697427:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787784535.697439:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750076800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784535.697546:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750076800:12345-0@lo:400:kworker.0 Request processed in 109us (4607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784535.697554:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787784535.697574:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787784535.697581:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750077312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784535.697625:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750077312:12345-0@lo:400:kworker.0 Request processed in 45us (4645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784535.697632:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787784535.697645:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787784535.697651:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750076928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784535.697682:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750076928:12345-0@lo:400:kworker.0 Request processed in 32us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784535.697702:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787784535.697713:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787784535.697718:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750076544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784535.697753:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750076544:12345-0@lo:400:kworker.0 Request processed in 34us (2863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784535.697759:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787784535.697797:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787784535.697805:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750077056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784535.697835:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750077056:12345-0@lo:400:kworker.0 Request processed in 32us (2917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784535.697841:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787784535.697879:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784535.697886:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784535.697889:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784535.697935:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750076800:0@lo:400:kworker.0 00010000:00080000:2.0:1787784535.697955:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951cffcb480 x1874627750077312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784535.697969:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750077312:0@lo:400:kworker.0 00000100:00100000:2.0:1787784535.697986:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750076672:0@lo:400:kworker.0 00000100:00100000:2.0:1787784535.698002:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750077184:0@lo:400:kworker.0 00000100:00100000:0.0:1787784535.698114:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784535.698149:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750077568 00000100:00100000:0.0:1787784535.698155:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750077568 00000100:00100000:0.0:1787784535.698198:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784535.698205:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750077568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784535.698226:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784535.698271:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750077568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (3294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784535.698278:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784535.698440:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750076544:0@lo:400:kworker.0 00010000:00080000:0.0:1787784535.698455:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f52912c0 x1874627750077056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784535.698465:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750077056:0@lo:400:kworker.0 00010000:00080000:0.0:1787784535.698477:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36d12c0 x1874627750077568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784535.698502:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750077568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784535.698518:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750076416:0@lo:400:kworker.0 00000100:00100000:0.0:1787784535.698531:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750076928:0@lo:400:kworker.0 00010000:00080000:0.0:1787784535.698542:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951cffcb0c0 x1874627750077440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784535.698549:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750077440:0@lo:400:kworker.0 00000100:00100000:1.0:1787784536.372794:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784536.372854:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784536.372972:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784536.373095:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727991168 00000100:00100000:0.0:1787784536.373109:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727991168 00000100:00100000:0.0:1787784536.373194:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727991296 00000100:00100000:0.0:1787784536.373197:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727991296 00000100:00100000:0.0:1787784536.373224:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 94 00000100:00100000:0.0:1787784536.373244:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff474780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727991168:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784536.373346:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff474780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727991168:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 106us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784536.373355:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 94 00000100:00100000:0.0:1787784536.373375:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00100000:0.0:1787784536.373381:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627727991296:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784536.373409:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627727991296:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784536.373416:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00080000:1.0:1787784536.373663:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784536.373669:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784536.374826:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727991040 00000100:00100000:2.0:1787784536.374840:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727991040 00000100:00100000:2.0:1787784536.374903:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 280 00000100:00100000:2.0:1787784536.374913:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2408:x1874627727991040:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784536.375033:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2408:x1874627727991040:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 121us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784536.375043:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 280 00000100:00100000:1.0:1787784536.390111:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784536.390184:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784536.390286:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727991424 00000100:00100000:0.0:1787784536.390300:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727991424 00000100:00100000:0.0:1787784536.390385:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727991552 00000100:00100000:0.0:1787784536.390399:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727991552 00000100:00100000:0.0:1787784536.390430:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:0.0:1787784536.390441:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2404:x1874627727991424:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:0.0:1787784536.390491:0:8916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cd32 00000100:00080000:0.0:1787784536.390504:0:8916:0:(import.c:65:import_set_state_nolock()) ffff8950c26ec800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784536.390581:0:8916:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787784536.390838:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+2:2404:x1874627727991424:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 398us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784536.390848:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:0.0:1787784536.390867:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1787784536.390875:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff476580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2404:x1874627727991552:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:0.0:1787784536.390890:0:8916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cd39 00000100:00080000:0.0:1787784536.390897:0:8916:0:(import.c:65:import_set_state_nolock()) ffff8950c26ed000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784536.390927:0:8916:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787784536.391013:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff476580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+2:2404:x1874627727991552:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 137us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784536.391020:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00010000:00010000:0.0:1787784536.391121:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784536.391128:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787784536.391475:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784536.391481:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787784536.582570:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784537.234837:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750077696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784537.234945:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784537.235110:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750077696 00000100:00100000:3.0:1787784537.235122:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750077696 00000100:00100000:3.0:1787784537.235203:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787784537.235215:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750077696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784537.235274:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787784537.235340:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750077696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784537.235349:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787784537.235409:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750077696:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784537.607273:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784538.632092:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784539.657425:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787784539.678340:0:10941:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing yml_node 00000100:00100000:2.0:1787784540.299794:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750077824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784540.299869:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784540.300025:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750077952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784540.300054:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784540.300101:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750077824 00000100:00100000:3.0:1787784540.300108:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750077824 00000100:00100000:3.0:1787784540.300154:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750077952 00000100:00100000:3.0:1787784540.300157:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750077952 00000100:00100000:3.0:1787784540.300174:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787784540.300183:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750077824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784540.300232:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784540.300318:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787784540.300328:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750077952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784540.300347:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784540.300382:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750077952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784540.300389:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787784540.301670:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784540.301688:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750078080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784540.301736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784540.301801:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750078080 00000100:00100000:1.0:1787784540.301807:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750078080 00000100:00100000:1.0:1787784540.301842:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787784540.301850:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff474f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750078080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784540.301877:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787784540.301919:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff474f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750078080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784540.301927:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787784540.301967:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750078080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784540.308887:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750077824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8693us (9006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784540.308902:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787784540.308971:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36d2d00 x1874627750077952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784540.308995:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750077952:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787784540.317848:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff4770c0 x1874627750077824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784540.317883:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750077824:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787784540.690570:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784540.808706:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3576580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750078208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784540.808806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784540.808861:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784540.808868:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750078336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784540.808889:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784540.808921:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750078208 00000100:00100000:0.0:1787784540.808927:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750078208 00000100:00100000:0.0:1787784540.808972:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750078336 00000100:00100000:0.0:1787784540.808975:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750078336 00000100:00100000:0.0:1787784540.808991:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787784540.808999:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750078208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784540.809028:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784540.809067:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750078208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784540.809075:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787784540.809089:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784540.809095:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750078336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787784540.809105:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784540.809125:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750078336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784540.809132:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787784540.809150:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787784540.809186:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c35770c0 x1874627750078336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784540.809205:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750078336:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787784540.809229:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3576580 x1874627750078208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784540.809241:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3576580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750078208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784540.809653:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750078848:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.809688:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784540.809706:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750079360:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.809727:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784540.809742:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787784540.809747:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750078720:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.809789:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784540.809807:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750079232:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.809843:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784540.809865:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750079744:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.812822:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784540.812918:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750078592:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.812986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784540.813003:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750079104:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.813041:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784540.813052:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750079616:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.813069:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784540.813086:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787784540.813092:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750078464:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.813117:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784540.813142:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750078976:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.813162:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784540.813181:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750079488:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.813202:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784540.813243:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750078720 00000100:00100000:2.0:1787784540.813252:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750078720 00000100:00100000:2.0:1787784540.813290:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750078976 00000100:00100000:2.0:1787784540.813293:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750078976 00000100:00100000:2.0:1787784540.813308:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787784540.813315:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750078720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.813385:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750078720:12345-0@lo:400:kworker.0 Request processed in 70us (3595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784540.813393:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787784540.813409:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787784540.813415:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750078976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.813458:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750078976:12345-0@lo:400:kworker.0 Request processed in 43us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784540.813464:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787784540.813483:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750078848 00000100:00100000:2.0:1787784540.813490:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750078848 00000100:00100000:2.0:1787784540.813518:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750079232 00000100:00100000:2.0:1787784540.813522:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750079232 00000100:00100000:2.0:1787784540.813542:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750079744 00000100:00100000:2.0:1787784540.813545:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750079744 00000100:00100000:2.0:1787784540.813557:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750078592 00000100:00100000:2.0:1787784540.813747:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750078592 00000100:00100000:2.0:1787784540.813790:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750079104 00000100:00100000:2.0:1787784540.813794:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750079104 00000100:00100000:2.0:1787784540.813809:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750079616 00000100:00100000:2.0:1787784540.813812:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750079616 00000100:00100000:2.0:1787784540.813828:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787784540.813834:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750078848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.813869:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750078848:12345-0@lo:400:kworker.0 Request processed in 36us (4181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784540.813876:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787784540.813888:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787784540.813894:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750079232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.813918:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750079232:12345-0@lo:400:kworker.0 Request processed in 25us (4075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784540.813923:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787784540.813932:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787784540.813937:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750079744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.813962:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750079744:12345-0@lo:400:kworker.0 Request processed in 25us (4075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784540.813968:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787784540.813978:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787784540.813984:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750078592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.814011:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750078592:12345-0@lo:400:kworker.0 Request processed in 27us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784540.814023:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787784540.814035:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787784540.814040:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750079104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.814068:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750079104:12345-0@lo:400:kworker.0 Request processed in 28us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784540.814073:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787784540.814082:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787784540.814088:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750079616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.814115:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750079616:12345-0@lo:400:kworker.0 Request processed in 27us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784540.814120:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787784540.814171:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750078976:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.814183:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750078592:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.814192:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750079104:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.814202:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750079616:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.814425:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750078720:0@lo:400:kworker.0 00010000:00080000:2.0:1787784540.814508:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3410f00 x1874627750079232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784540.814520:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750079232:0@lo:400:kworker.0 00010000:00080000:2.0:1787784540.814533:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3412940 x1874627750079744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784540.814541:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750079744:0@lo:400:kworker.0 00000100:00100000:2.0:1787784540.815724:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750078848:0@lo:400:kworker.0 00000100:00100000:0.0:1787784540.816399:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750079360 00000100:00100000:0.0:1787784540.816408:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750079360 00000100:00100000:0.0:1787784540.816465:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750079488 00000100:00100000:0.0:1787784540.816469:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750079488 00000100:00100000:0.0:1787784540.816494:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787784540.816502:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750079360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784540.816602:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750079360:12345-0@lo:400:kworker.0 Request processed in 100us (6873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784540.816611:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787784540.816626:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787784540.816632:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750079488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784540.816663:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750079488:12345-0@lo:400:kworker.0 Request processed in 32us (3460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784540.816670:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787784540.816687:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750078464 00000100:00100000:0.0:1787784540.816691:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750078464 00000100:00100000:0.0:1787784540.816713:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787784540.816720:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3647:x1874627750078464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784540.816749:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3647:x1874627750078464:12345-0@lo:400:kworker.0 Request processed in 29us (3631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784540.816792:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:0.0:1787784540.816826:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784540.816832:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784540.816867:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750078464:0@lo:400:kworker.0 00010000:00080000:0.0:1787784540.816882:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3413840 x1874627750079488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784540.816895:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750079488:0@lo:400:kworker.0 00010000:00080000:0.0:1787784540.816922:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c34103c0 x1874627750079360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784540.816932:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750079360:0@lo:400:kworker.0 00000100:00100000:0.0:1787784541.475765:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784541.475855:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784541.475897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784541.476157:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727991936 00000100:00100000:3.0:1787784541.476167:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727991936 00000100:00100000:3.0:1787784541.476235:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727991808 00000100:00100000:3.0:1787784541.476239:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727991808 00000100:00100000:3.0:1787784541.476265:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 102 00000100:00100000:3.0:1787784541.476275:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3576580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627727991936:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784541.476373:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3576580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627727991936:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 99us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784541.476382:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 102 00000100:00100000:3.0:1787784541.476400:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 103 00000100:00100000:3.0:1787784541.476407:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627727991808:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784541.476434:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627727991808:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784541.476440:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 103 00000100:00080000:0.0:1787784541.476672:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784541.476676:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784541.477326:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727991680 00000100:00100000:2.0:1787784541.477333:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727991680 00000100:00100000:2.0:1787784541.477384:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 282 00000100:00100000:2.0:1787784541.477394:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2405:x1874627727991680:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784541.477442:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2405:x1874627727991680:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 50us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784541.477449:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 282 00010000:00010000:0.0:1787784541.707651:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787784541.834284:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00000020:00000080:1.0:1787784541.834295:0:8431:0:(genops.c:885:class_export_put()) final put ffff8950c26ea800/2e90d38f-8956-47bc-80da-c902c22ae09c 00000020:00000080:3.0:1787784541.834385:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c26ea800/2e90d38f-8956-47bc-80da-c902c22ae09c for lustre-OST0000 00000020:00000080:3.0:1787784541.834442:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c26ec800 for lustre-OST0000 00000001:00100000:0.0:1787784541.834647:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00000020:00000080:0.0:1787784541.834652:0:9516:0:(genops.c:885:class_export_put()) final put ffff8950c26e9800/2e90d38f-8956-47bc-80da-c902c22ae09c 00000020:00000080:2.0:1787784541.835140:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c26e9800/2e90d38f-8956-47bc-80da-c902c22ae09c for lustre-OST0001 00000020:00000080:2.0:1787784541.835188:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c26ed000 for lustre-OST0001 00000100:00100000:1.0:1787784542.344437:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784542.344463:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750079872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784542.344536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784542.344681:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750079872 00000100:00100000:2.0:1787784542.344689:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750079872 00000100:00100000:2.0:1787784542.344739:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787784542.344748:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750079872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787784542.344804:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787784542.344852:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750079872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784542.344859:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787784542.345004:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750079872:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784542.726567:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784543.755028:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787784544.533229:0:11125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.54 00010000:00010000:2.0:1787784544.773980:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784545.415435:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784545.415463:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff475680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750080000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784545.415550:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784545.415621:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750080000 00000100:00100000:2.0:1787784545.415628:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750080000 00000100:00100000:2.0:1787784545.415683:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787784545.415704:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750080000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784545.415741:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787784545.415814:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750080000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784545.415821:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787784545.415872:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff475680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750080000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784545.416817:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff476940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750080128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784545.416861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784545.416970:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750080128 00000100:00100000:1.0:1787784545.416976:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750080128 00000100:00100000:1.0:1787784545.417024:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787784545.417032:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750080128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784545.417066:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784545.417104:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750080128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784545.417111:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787784545.417222:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787784545.417246:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff476940 x1874627750080128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784545.417264:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff476940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750080128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784545.421296:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784545.421322:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750080256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784545.421391:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784545.421444:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750080256 00000100:00100000:0.0:1787784545.421452:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750080256 00000100:00100000:0.0:1787784545.421505:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787784545.421514:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750080256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784545.421557:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784545.421601:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750080256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.421608:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787784545.421639:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787784545.421679:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3577840 x1874627750080256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784545.421694:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750080256:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787784545.798102:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784545.926068:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750080384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784545.926145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784545.926435:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750080384 00000100:00100000:0.0:1787784545.926444:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750080384 00000100:00100000:0.0:1787784545.926506:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784545.926526:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff477c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750080384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784545.926557:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784545.926603:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff477c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750080384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.926610:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787784545.926652:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3577840 x1874627750080384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784545.926676:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750080384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784545.926838:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750080512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784545.926870:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787784545.926988:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784545.927145:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750080512 00000100:00100000:0.0:1787784545.927150:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750080512 00000100:00100000:0.0:1787784545.927191:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787784545.927198:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750080512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787784545.927209:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784545.927244:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750080512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.927251:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787784545.927264:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784545.927274:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750080896:0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.927302:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784545.927319:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750081408:0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.927341:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784545.927358:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750081920:0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.927378:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784545.927396:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787784545.927402:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3576940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750080768:0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.927437:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784545.927454:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3575e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750081280:0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.927477:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784545.927491:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3574780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750081792:0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.927511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784545.927542:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750081408 00000100:00100000:0.0:1787784545.927546:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750081408 00000100:00100000:0.0:1787784545.927571:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750081920 00000100:00100000:0.0:1787784545.927574:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750081920 00000100:00100000:0.0:1787784545.927588:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750080768 00000100:00100000:0.0:1787784545.927590:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750080768 00000100:00100000:0.0:1787784545.927601:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750081280 00000100:00100000:0.0:1787784545.927603:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750081280 00000100:00100000:0.0:1787784545.927616:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750081792 00000100:00100000:0.0:1787784545.927618:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750081792 00000100:00100000:0.0:1787784545.927631:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787784545.927644:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750081408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.927686:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750081408:12345-0@lo:400:kworker.0 Request processed in 44us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.927693:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787784545.927706:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787784545.927712:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750081920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.927738:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750081920:12345-0@lo:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.927743:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787784545.927756:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787784545.927761:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff456940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750080768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.927821:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff456940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750080768:12345-0@lo:400:kworker.0 Request processed in 60us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.927827:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787784545.927839:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787784545.927845:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff457c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750081280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.927882:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff457c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750081280:12345-0@lo:400:kworker.0 Request processed in 37us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.927888:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787784545.927900:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787784545.927907:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750081792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.927933:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750081792:12345-0@lo:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.927939:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1787784545.927957:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784545.927965:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784545.927987:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3576940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750080768:0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.927997:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3575e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750081280:0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.928005:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3574780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750081792:0@lo:400:kworker.0 00010000:00080000:0.0:1787784545.928015:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3574000 x1874627750081408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784545.928023:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750081408:0@lo:400:kworker.0 00010000:00080000:0.0:1787784545.928031:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d9e112c0 x1874627750081920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784545.928038:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750081920:0@lo:400:kworker.0 00000100:00100000:1.0:1787784545.928246:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3574b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750081024:0@lo:400:kworker.0 00000100:00100000:1.0:1787784545.928269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784545.928288:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3576d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750081536:0@lo:400:kworker.0 00000100:00100000:1.0:1787784545.928303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787784545.928318:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36ffc00 x1874627750080512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784545.928327:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750080512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784545.928337:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787784545.928340:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750080640:0@lo:400:kworker.0 00000100:00100000:1.0:1787784545.928358:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784545.928372:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750081152:0@lo:400:kworker.0 00000100:00100000:1.0:1787784545.928384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784545.928391:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750081664:0@lo:400:kworker.0 00000100:00100000:1.0:1787784545.928406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784545.928477:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750080896 00000100:00100000:2.0:1787784545.928481:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750080896 00000100:00100000:2.0:1787784545.928499:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750081152 00000100:00100000:2.0:1787784545.928501:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750081152 00000100:00100000:2.0:1787784545.928523:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787784545.928530:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2667c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750080896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784545.928577:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2667c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750080896:12345-0@lo:400:kworker.0 Request processed in 48us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784545.928582:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787784545.928592:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787784545.928596:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff475e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750081152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784545.928626:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff475e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750081152:12345-0@lo:400:kworker.0 Request processed in 29us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784545.928629:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787784545.928642:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750081024 00000100:00100000:2.0:1787784545.928644:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750081024 00000100:00100000:2.0:1787784545.928657:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787784545.928661:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff474b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750081024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784545.928678:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff474b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750081024:12345-0@lo:400:kworker.0 Request processed in 17us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784545.928682:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787784545.928704:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750081152:0@lo:400:kworker.0 00000100:00100000:2.0:1787784545.928710:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3574b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750081024:0@lo:400:kworker.0 00000100:00100000:1.0:1787784545.928796:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750080896:0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.928866:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750081536 00000100:00100000:0.0:1787784545.928869:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750081536 00000100:00100000:0.0:1787784545.929227:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750081664 00000100:00100000:0.0:1787784545.929230:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750081664 00000100:00100000:1.0:1787784545.935847:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787784545.935969:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750081536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784545.936097:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750081536:12345-0@lo:400:kworker.0 Request processed in 236us (7791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784545.936105:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787784545.936130:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787784545.936137:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff476940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750081664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784545.936166:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff476940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750081664:12345-0@lo:400:kworker.0 Request processed in 30us (7758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784545.936184:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787784545.937376:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3575a40 x1874627750081664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784545.937394:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750081664:0@lo:400:kworker.0 00010000:00080000:1.0:1787784545.937407:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3576d00 x1874627750081536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784545.937415:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3576d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750081536:0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.940400:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750080640 00000100:00100000:0.0:1787784545.940415:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750080640 00000100:00100000:0.0:1787784545.940470:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787784545.940477:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750080640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784545.940631:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750080640:12345-0@lo:400:kworker.0 Request processed in 154us (12271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.940637:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787784545.941822:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750080640:0@lo:400:kworker.0 00000100:00100000:0.0:1787784546.590468:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784546.590544:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784546.590573:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784546.590797:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727992320 00000100:00100000:1.0:1787784546.590820:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727992320 00000100:00100000:1.0:1787784546.590885:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727992192 00000100:00100000:1.0:1787784546.590888:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727992192 00000100:00100000:1.0:1787784546.590916:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 110 00000100:00100000:1.0:1787784546.590926:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627727992320:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784546.591002:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627727992320:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 78us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784546.591009:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 110 00000100:00100000:1.0:1787784546.591023:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 111 00000100:00100000:1.0:1787784546.591028:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff455e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627727992192:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784546.591047:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff455e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627727992192:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 19us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784546.591052:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 111 00000100:00080000:0.0:1787784546.591188:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784546.591197:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784546.591325:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727992064 00000100:00100000:2.0:1787784546.591331:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727992064 00000100:00100000:2.0:1787784546.591365:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 284 00000100:00100000:2.0:1787784546.591371:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2406:x1874627727992064:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784546.591413:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2406:x1874627727992064:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 42us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784546.591419:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 284 00010000:00010000:1.0:1787784546.822124:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784547.465648:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff477840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750082048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784547.465728:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784547.466616:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750082048 00000100:00100000:1.0:1787784547.466627:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750082048 00000100:00100000:1.0:1787784547.466676:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787784547.466685:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750082048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787784547.466725:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787784547.469941:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750082048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3249us (4205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784547.469956:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787784547.470545:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff477840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750082048:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1787784547.696352:0:11222:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.54 00010000:00010000:2.0:1787784547.848170:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784548.871748:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784549.901879:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784550.539509:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750082176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784550.539597:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784550.539670:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784550.539678:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff475680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750082304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784550.539720:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784550.539782:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750082176 00000100:00100000:1.0:1787784550.539790:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750082176 00000100:00100000:1.0:1787784550.539841:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787784550.539851:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff477840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750082176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784550.539880:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784550.539920:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff477840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750082176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784550.539928:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787784550.539950:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750082304 00000100:00100000:1.0:1787784550.539953:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750082304 00000100:00100000:1.0:1787784550.539978:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787784550.539984:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750082304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784550.540020:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787784550.540056:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750082304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784550.540061:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1787784550.540076:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784550.543649:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff475680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750082304:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1787784550.543735:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff474000 x1874627750082176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784550.543754:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750082176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784550.546848:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750082432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784550.546923:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784550.546991:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750082432 00000100:00100000:3.0:1787784550.546998:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750082432 00000100:00100000:3.0:1787784550.547048:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787784550.547056:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750082432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784550.547077:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784550.547116:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750082432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784550.547123:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787784550.547142:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787784550.547166:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36d2580 x1874627750082432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784550.547191:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750082432:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1787784550.700633:0:11320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.54 00010000:00010000:3.0:1787784550.917948:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784551.049500:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750082944:0@lo:400:kworker.0 00000100:00100000:3.0:1787784551.049587:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784551.049714:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750082944 00000100:00100000:2.0:1787784551.049722:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750082944 00000100:00100000:2.0:1787784551.049791:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787784551.049801:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750082944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.049856:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750082944:12345-0@lo:400:kworker.0 Request processed in 57us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784551.049864:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787784551.049894:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff456d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750082560:0@lo:400:kworker.0 00000100:00100000:1.0:1787784551.051134:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff455a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750082688:0@lo:400:kworker.0 00000100:00100000:3.0:1787784551.055009:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750082944:0@lo:400:kworker.0 00000100:00100000:3.0:1787784551.055026:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750083456:0@lo:400:kworker.0 00000100:00100000:3.0:1787784551.055093:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784551.055169:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff455680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750083968:0@lo:400:kworker.0 00000100:00100000:3.0:1787784551.055195:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784551.055656:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1787784551.055665:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750082816:0@lo:400:kworker.0 00000100:00100000:3.0:1787784551.055697:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784551.055729:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750083200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784551.055752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784551.055806:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff457840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750083840:0@lo:400:kworker.0 00000100:00100000:3.0:1787784551.055829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784551.055855:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750084352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784551.055874:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784551.056020:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784551.056049:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750083968 00000100:00100000:2.0:1787784551.056056:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750083968 00000100:00100000:2.0:1787784551.056107:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750083840 00000100:00100000:2.0:1787784551.056110:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750083840 00000100:00100000:2.0:1787784551.056130:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787784551.056154:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750082816 00000100:00100000:2.0:1787784551.056155:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750083968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784551.056161:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750082816 00000100:00100000:1.0:1787784551.056194:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787784551.056204:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750082816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784551.056365:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750083456 00000100:00100000:3.0:1787784551.056370:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750083456 00000100:00100000:3.0:1787784551.056395:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787784551.056402:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750083840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784551.056492:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787784551.056502:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787784551.056620:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787784551.056628:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750083456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784551.058987:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750082816:12345-0@lo:400:kworker.0 Request processed in 2775us (3278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784551.059000:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787784551.059074:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784551.059113:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750083328:0@lo:400:kworker.0 00000100:00100000:1.0:1787784551.059140:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784551.059156:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff454f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750083712:0@lo:400:kworker.0 00000100:00100000:1.0:1787784551.059179:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784551.059211:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750084224:0@lo:400:kworker.0 00000100:00100000:1.0:1787784551.059236:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784551.059263:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750083712 00000100:00100000:1.0:1787784551.059270:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750083712 00000100:00100000:1.0:1787784551.059308:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750084224 00000100:00100000:1.0:1787784551.059311:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750084224 00000100:00100000:1.0:1787784551.059334:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787784551.059342:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3387c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750083712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784551.059386:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3387c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750083712:12345-0@lo:400:kworker.0 Request processed in 45us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784551.059392:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787784551.059403:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787784551.059409:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbf0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750084224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784551.059436:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbf0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750084224:12345-0@lo:400:kworker.0 Request processed in 27us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784551.059477:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787784551.059633:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d9e112c0 x1874627750084224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784551.059647:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750084224:0@lo:400:kworker.0 00010000:00080000:1.0:1787784551.059672:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff454f00 x1874627750083712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784551.059681:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff454f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750083712:0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.062437:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750083968:12345-0@lo:400:kworker.0 Request processed in 6286us (7227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784551.062452:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787784551.062494:0:7991:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787784551.062507:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750082688 00000100:00100000:2.0:1787784551.062514:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750082688 00000100:00100000:2.0:1787784551.062551:0:7991:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787784551.062568:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750083328 00000100:00100000:2.0:1787784551.062572:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750083328 00000100:00100000:2.0:1787784551.062593:0:7991:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787784551.062600:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787784551.062607:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750082688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.062690:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750082688:12345-0@lo:400:kworker.0 Request processed in 83us (3615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784551.062697:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787784551.062707:0:7991:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787784551.062712:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787784551.062718:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750083328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.062745:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750083328:12345-0@lo:400:kworker.0 Request processed in 28us (3604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784551.062750:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787784551.062792:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750082560 00000100:00100000:2.0:1787784551.062796:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750082560 00000100:00100000:2.0:1787784551.062829:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787784551.062835:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750082560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.062867:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750082560:12345-0@lo:400:kworker.0 Request processed in 33us (6847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784551.062873:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787784551.062957:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff456d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750082560:0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.062969:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750083072:0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.063004:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784551.063035:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750083072 00000100:00100000:2.0:1787784551.063039:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750083072 00000100:00100000:2.0:1787784551.063064:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787784551.063077:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750083072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.063111:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750083072:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784551.063118:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787784551.064812:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff455a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750082688:0@lo:400:kworker.0 00000100:00100000:1.0:1787784551.064831:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750083328:0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.065355:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750083072:0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.065366:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750083584:0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.065424:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784551.065451:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750084096:0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.065483:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784551.065518:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750083584 00000100:00100000:2.0:1787784551.065523:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750083584 00000100:00100000:2.0:1787784551.065564:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750084096 00000100:00100000:2.0:1787784551.065567:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750084096 00000100:00100000:2.0:1787784551.065591:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787784551.065599:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750083584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.065647:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750083584:12345-0@lo:400:kworker.0 Request processed in 48us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784551.065657:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787784551.065672:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787784551.065678:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750084096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.065706:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750084096:12345-0@lo:400:kworker.0 Request processed in 29us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784551.065711:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787784551.065742:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff454000 x1874627750084096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784551.065754:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750084096:0@lo:400:kworker.0 00010000:00080000:2.0:1787784551.065812:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff4561c0 x1874627750083584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784551.065821:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750083584:0@lo:400:kworker.0 00000100:00100000:2.0:1787784551.065860:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750083200 00000100:00100000:2.0:1787784551.065864:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750083200 00000100:00100000:2.0:1787784551.065894:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750084352 00000100:00100000:2.0:1787784551.065898:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750084352 00000100:00100000:2.0:1787784551.065912:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787784551.065918:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750083200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787784551.065941:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784551.065976:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750083200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (10223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784551.065982:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787784551.065994:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787784551.066000:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750084352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784551.066009:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784551.066032:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750084352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (10157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784551.066038:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1787784551.066066:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784551.066071:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784551.066074:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784551.066096:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750082816:0@lo:400:kworker.0 00010000:00080000:2.0:1787784551.066106:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36fde00 x1874627750083200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784551.066119:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750083200:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787784551.066142:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3387840 x1874627750084352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784551.066154:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750084352:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787784551.066166:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff455680 x1874627750083968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784551.066174:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff455680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750083968:0@lo:400:kworker.0 00000100:00100000:1.0:1787784551.068267:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff457840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750083840:0@lo:400:kworker.0 00000100:00100000:3.0:1787784551.068603:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750083840:12345-0@lo:400:kworker.0 Request processed in 11731us (12301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784551.068628:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787784551.068804:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750083456:12345-0@lo:400:kworker.0 Request processed in 12175us (13709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784551.068812:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:1.0:1787784551.073903:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff4570c0 x1874627750083456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784551.073933:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750083456:0@lo:400:kworker.0 00000100:00100000:0.0:1787784551.720666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784551.720716:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784551.720753:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784551.720806:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727992704 00000100:00100000:0.0:1787784551.720816:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727992704 00000100:00100000:0.0:1787784551.720891:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727992576 00000100:00100000:0.0:1787784551.720895:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727992576 00000100:00100000:0.0:1787784551.721008:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 118 00000100:00100000:0.0:1787784551.721019:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627727992704:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784551.721285:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627727992704:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 266us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784551.721294:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 118 00000100:00100000:0.0:1787784551.721315:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:0.0:1787784551.721322:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3577840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627727992576:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784551.721350:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3577840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627727992576:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784551.721370:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00080000:0.0:1787784551.721391:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784551.721394:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787784551.724626:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727992448 00000100:00100000:1.0:1787784551.724642:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727992448 00000100:00100000:1.0:1787784551.724710:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 286 00000100:00100000:1.0:1787784551.724721:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2405:x1874627727992448:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784551.724817:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2405:x1874627727992448:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 97us (4164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784551.724825:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 286 00010000:00010000:0.0:1787784551.947989:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787784552.490167:0:11369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 26 18:49:10 EDT 2026 00000100:00100000:3.0:1787784552.582946:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784552.582968:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750084480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787784552.583037:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784552.583138:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750084480 00000100:00100000:0.0:1787784552.583147:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750084480 00000100:00100000:0.0:1787784552.583201:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787784552.583212:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750084480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784552.583258:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784552.583309:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750084480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784552.583317:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787784552.583521:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750084480:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784552.966578:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784553.996031:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784555.015188:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784555.654049:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750084608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784555.654156:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784555.654240:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750084864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784555.654269:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3387c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750084736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784555.654303:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784555.654441:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784555.654548:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750084864 00000100:00100000:0.0:1787784555.654558:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750084864 00000100:00100000:0.0:1787784555.654635:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787784555.654647:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750084864:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784555.654685:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750084608 00000100:00100000:2.0:1787784555.654690:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750084608 00000004:00000024:0.0:1787784555.654694:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787784555.654751:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750084864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784555.654759:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1787784555.654814:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784555.654854:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750084736 00000100:00100000:2.0:1787784555.654858:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750084736 00000100:00100000:1.0:1787784555.654860:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750084864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784555.654919:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787784555.654929:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750084608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784555.654952:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784555.654991:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750084608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784555.654998:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787784555.655015:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787784555.655021:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff457840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750084736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784555.655029:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784555.655058:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff457840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750084736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784555.655064:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787784555.655094:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3387c00 x1874627750084736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784555.655110:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3387c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750084736:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787784555.655138:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff4570c0 x1874627750084608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784555.655166:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750084608:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787784555.655183:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787784556.039231:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784556.166272:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3574b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750084992:0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.166349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784556.166414:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3575e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750085504:0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.166467:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784556.166489:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3576d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750086016:0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.166511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784556.166528:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff471a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750086528:0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.166546:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784556.166570:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787784556.166576:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3574780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750085376:0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.166602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784556.166617:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750085888:0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.166637:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784556.166671:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff472d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750086400:0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.166692:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784556.166720:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750085248:0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.166744:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784556.166761:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750085760:0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.166813:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784556.166840:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750086272:0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.166862:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784556.166882:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787784556.166888:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750085120:0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.166907:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784556.166924:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3576940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750085632:0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.167123:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784556.167145:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750086144:0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.167168:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784556.167193:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750085504 00000100:00100000:1.0:1787784556.167199:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750085504 00000100:00100000:1.0:1787784556.167231:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750085248 00000100:00100000:1.0:1787784556.167233:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750085248 00000100:00100000:1.0:1787784556.167244:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787784556.167251:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c33852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750085504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.167298:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c33852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750085504:12345-0@lo:400:kworker.0 Request processed in 48us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784556.167305:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787784556.167319:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787784556.167324:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750085248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.167348:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750085248:12345-0@lo:400:kworker.0 Request processed in 24us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784556.167353:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787784556.167367:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750086016 00000100:00100000:1.0:1787784556.167370:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750086016 00000100:00100000:1.0:1787784556.167384:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750086528 00000100:00100000:1.0:1787784556.167386:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750086528 00000100:00100000:1.0:1787784556.167412:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750085888 00000100:00100000:1.0:1787784556.167415:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750085888 00000100:00100000:1.0:1787784556.167439:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750086400 00000100:00100000:1.0:1787784556.167442:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750086400 00000100:00100000:1.0:1787784556.167458:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787784556.167463:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750086016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.167494:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750086016:12345-0@lo:400:kworker.0 Request processed in 31us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784556.167501:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787784556.167513:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787784556.167519:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750086528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.167546:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750086528:12345-0@lo:400:kworker.0 Request processed in 27us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784556.167552:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787784556.167562:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784556.167568:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750085888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.167594:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750085888:12345-0@lo:400:kworker.0 Request processed in 26us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784556.167599:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784556.167609:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787784556.167613:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750086400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784556.167633:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750086400:12345-0@lo:400:kworker.0 Request processed in 20us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784556.167637:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787784556.167905:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750085376 00000100:00100000:3.0:1787784556.167910:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750085376 00000100:00100000:3.0:1787784556.167931:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750085760 00000100:00100000:3.0:1787784556.167934:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750085760 00000100:00100000:3.0:1787784556.167959:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750086272 00000100:00100000:3.0:1787784556.167962:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750086272 00000100:00100000:3.0:1787784556.167973:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750085120 00000100:00100000:3.0:1787784556.167975:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750085120 00000100:00100000:3.0:1787784556.167984:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750085632 00000100:00100000:3.0:1787784556.167986:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750085632 00000100:00100000:3.0:1787784556.167995:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750086144 00000100:00100000:3.0:1787784556.167997:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750086144 00000100:00100000:3.0:1787784556.168007:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787784556.168013:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750085376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784556.168046:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750085376:12345-0@lo:400:kworker.0 Request processed in 34us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784556.168052:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787784556.168062:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787784556.168067:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c33843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750085760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784556.168090:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c33843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750085760:12345-0@lo:400:kworker.0 Request processed in 24us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784556.168096:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787784556.168106:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787784556.168112:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750086272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784556.168138:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750086272:12345-0@lo:400:kworker.0 Request processed in 26us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784556.168153:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787784556.168165:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787784556.168170:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c33870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750085120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784556.168196:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c33870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750085120:12345-0@lo:400:kworker.0 Request processed in 26us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784556.168201:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787784556.168210:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787784556.168216:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c33861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750085632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784556.168238:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c33861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750085632:12345-0@lo:400:kworker.0 Request processed in 22us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784556.168243:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787784556.168251:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787784556.168256:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750086144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784556.168278:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750086144:12345-0@lo:400:kworker.0 Request processed in 22us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784556.168283:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787784556.168342:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3574780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750085376:0@lo:400:kworker.0 00010000:00080000:3.0:1787784556.168355:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3575a40 x1874627750085888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784556.168364:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750085888:0@lo:400:kworker.0 00010000:00080000:3.0:1787784556.168373:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff472d00 x1874627750086400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784556.168380:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff472d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750086400:0@lo:400:kworker.0 00000100:00100000:3.0:1787784556.168397:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3575e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750085504:0@lo:400:kworker.0 00010000:00080000:3.0:1787784556.168406:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3576d00 x1874627750086016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784556.168414:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3576d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750086016:0@lo:400:kworker.0 00010000:00080000:3.0:1787784556.168434:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff471a40 x1874627750086528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784556.168442:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff471a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750086528:0@lo:400:kworker.0 00000100:00100000:3.0:1787784556.168485:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750085120:0@lo:400:kworker.0 00000100:00100000:3.0:1787784556.168496:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3576940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750085632:0@lo:400:kworker.0 00000100:00100000:3.0:1787784556.168504:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750086144:0@lo:400:kworker.0 00000100:00100000:3.0:1787784556.168513:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750085248:0@lo:400:kworker.0 00010000:00080000:3.0:1787784556.168522:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3577c00 x1874627750085760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784556.168530:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750085760:0@lo:400:kworker.0 00010000:00080000:3.0:1787784556.168537:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff470000 x1874627750086272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784556.168544:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750086272:0@lo:400:kworker.0 00000100:00080000:3.0:1787784556.168572:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784556.168576:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784556.168579:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784556.169124:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750084992 00000100:00100000:0.0:1787784556.169130:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750084992 00000100:00100000:0.0:1787784556.169177:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787784556.169185:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750084992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784556.169235:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750084992:12345-0@lo:400:kworker.0 Request processed in 51us (2886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784556.169251:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787784556.169467:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750086656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784556.169499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784556.169531:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750086656 00000100:00100000:2.0:1787784556.169534:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750086656 00000100:00100000:2.0:1787784556.169557:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787784556.169563:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750086656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787784556.169584:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784556.169612:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750086656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784556.169617:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787784556.169642:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36fd2c0 x1874627750086656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784556.169674:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750086656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784556.169763:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784556.169790:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff470780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750086784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784556.169816:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784556.169840:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750086784 00000100:00100000:0.0:1787784556.169844:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750086784 00000100:00100000:0.0:1787784556.169865:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787784556.169871:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750086784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784556.169880:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784556.169904:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750086784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784556.169910:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787784556.169933:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff470780 x1874627750086784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784556.169955:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff470780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750086784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784556.170406:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3574b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750084992:0@lo:400:kworker.0 00000100:00100000:0.0:1787784556.834920:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784556.834989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784556.835113:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727992960 00000100:00100000:3.0:1787784556.835122:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727992960 00000100:00100000:3.0:1787784556.835207:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 126 00000100:00100000:3.0:1787784556.835218:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff470780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727992960:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784556.835301:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff470780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727992960:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 84us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784556.835310:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 126 00000100:00100000:0.0:1787784556.835709:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784556.836365:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727993088 00000100:00100000:3.0:1787784556.836372:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727993088 00000100:00100000:3.0:1787784556.836428:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 127 00000100:00100000:3.0:1787784556.836438:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627727993088:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784556.836490:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627727993088:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 54us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784556.836497:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 127 00000100:00080000:1.0:1787784556.836649:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784556.836653:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784556.838248:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727992832 00000100:00100000:2.0:1787784556.838259:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727992832 00000100:00100000:2.0:1787784556.838357:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 288 00000100:00100000:2.0:1787784556.838368:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2408:x1874627727992832:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784556.838449:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2408:x1874627727992832:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 83us (3459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784556.838456:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 288 00010000:00010000:1.0:1787784557.063710:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784557.706048:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750086912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787784557.706157:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784557.706266:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750086912 00000100:00100000:3.0:1787784557.706275:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750086912 00000100:00100000:3.0:1787784557.706330:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787784557.706341:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750086912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784557.706392:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787784557.706464:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750086912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784557.706472:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787784557.706522:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750086912:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787784558.087326:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784559.109937:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784560.135040:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784560.777707:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784560.777741:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750087040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784560.777872:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784560.777966:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750087040 00000100:00100000:2.0:1787784560.777976:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750087040 00000100:00100000:2.0:1787784560.778038:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787784560.778049:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750087040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784560.778095:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787784560.778149:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750087040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784560.778157:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787784560.778213:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750087040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784560.781118:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750087296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784560.781215:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784560.781297:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784560.781304:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750087168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784560.781332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784560.781906:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750087296 00000100:00100000:1.0:1787784560.781919:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750087296 00000100:00100000:1.0:1787784560.781997:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750087168 00000100:00100000:1.0:1787784560.782001:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750087168 00000100:00100000:1.0:1787784560.782026:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787784560.782039:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750087296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784560.782080:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784560.782149:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750087296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784560.782158:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787784560.782178:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787784560.782185:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750087168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787784560.782195:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784560.782220:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750087168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784560.782226:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787784560.782266:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3387840 x1874627750087168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784560.782287:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750087168:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787784560.782298:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c23603c0 x1874627750087296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784560.782309:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750087296:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787784560.783124:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787784561.158229:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784561.285909:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784561.285935:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750087424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784561.286010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784561.286104:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750087424 00000100:00100000:2.0:1787784561.286113:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750087424 00000100:00100000:2.0:1787784561.286513:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787784561.286526:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750087424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787784561.286559:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784561.286608:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750087424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784561.286615:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1787784561.286636:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787784561.286670:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36fd2c0 x1874627750087424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784561.286690:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750087424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784561.286980:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff471680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750087936:0@lo:400:kworker.0 00000100:00100000:0.0:1787784561.287018:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784561.287053:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750088448:0@lo:400:kworker.0 00000100:00100000:0.0:1787784561.287075:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784561.287102:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787784561.287108:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750087552:0@lo:400:kworker.0 00000100:00100000:0.0:1787784561.287134:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784561.287451:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff472940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750088064:0@lo:400:kworker.0 00000100:00100000:0.0:1787784561.287476:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784561.287493:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff471e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750088576:0@lo:400:kworker.0 00000100:00100000:0.0:1787784561.287518:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784561.287549:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750087936 00000100:00100000:0.0:1787784561.287555:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750087936 00000100:00100000:0.0:1787784561.287586:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750088448 00000100:00100000:0.0:1787784561.287589:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750088448 00000100:00100000:0.0:1787784561.287610:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750088064 00000100:00100000:0.0:1787784561.287612:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750088064 00000100:00100000:0.0:1787784561.287625:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787784561.287632:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff472580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750087936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784561.287673:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff472580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750087936:12345-0@lo:400:kworker.0 Request processed in 42us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784561.287680:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787784561.287692:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787784561.287698:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750088448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784561.287909:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff470f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750087680:0@lo:400:kworker.0 00000100:00100000:2.0:1787784561.287937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784561.287951:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff473c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750088192:0@lo:400:kworker.0 00000100:00100000:2.0:1787784561.287969:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784561.287979:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750088704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784561.287997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784561.288016:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787784561.288022:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff473840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750087808:0@lo:400:kworker.0 00000100:00100000:3.0:1787784561.288200:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750087680 00000100:00100000:3.0:1787784561.288205:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750087680 00000100:00100000:3.0:1787784561.288224:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750088192 00000100:00100000:3.0:1787784561.288226:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750088192 00000100:00100000:3.0:1787784561.288239:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787784561.288245:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff471a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750088064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784561.292487:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750088448:12345-0@lo:400:kworker.0 Request processed in 3002us (3623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784561.292504:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787784561.292545:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787784561.292558:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750087680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784561.292635:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750087680:12345-0@lo:400:kworker.0 Request processed in 81us (4695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784561.292641:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787784561.292655:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787784561.292664:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750088192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784561.293132:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750088192:12345-0@lo:400:kworker.0 Request processed in 469us (5159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784561.293139:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787784561.293260:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750087552 00000100:00100000:0.0:1787784561.293268:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750087552 00000100:00100000:0.0:1787784561.293449:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787784561.293457:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750087552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784561.293498:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750087552:12345-0@lo:400:kworker.0 Request processed in 42us (6364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784561.293505:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787784561.293536:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750088576 00000100:00100000:0.0:1787784561.293540:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750088576 00000100:00100000:0.0:1787784561.293572:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787784561.293578:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff472d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750088576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784561.293609:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff472d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750088576:12345-0@lo:400:kworker.0 Request processed in 31us (6090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784561.293615:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787784561.293660:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750087552:0@lo:400:kworker.0 00010000:00080000:0.0:1787784561.293675:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff471e00 x1874627750088576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784561.293686:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff471e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750088576:0@lo:400:kworker.0 00000100:00100000:0.0:1787784561.293697:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff471680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750087936:0@lo:400:kworker.0 00010000:00080000:0.0:1787784561.293887:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff4712c0 x1874627750088448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784561.293909:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750088448:0@lo:400:kworker.0 00000100:00100000:1.0:1787784561.298510:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750088704 00000100:00100000:1.0:1787784561.298546:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750088704 00000100:00100000:1.0:1787784561.298609:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787784561.298620:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750088704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784561.298646:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784561.299960:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff471a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750088064:12345-0@lo:400:kworker.0 Request processed in 11708us (12476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784561.299974:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787784561.301553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784561.301606:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750087808 00000100:00100000:2.0:1787784561.301615:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750087808 00000100:00100000:2.0:1787784561.301662:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787784561.301671:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750087808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784561.301902:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff472940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750088064:0@lo:400:kworker.0 00000100:00100000:2.0:1787784561.303892:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750087808:12345-0@lo:400:kworker.0 Request processed in 2213us (2335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784561.303915:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787784561.303988:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff473840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750087808:0@lo:400:kworker.0 00000100:00100000:2.0:1787784561.304001:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff470b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750088320:0@lo:400:kworker.0 00000100:00100000:2.0:1787784561.304054:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784561.304096:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff470f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750087680:0@lo:400:kworker.0 00010000:00080000:2.0:1787784561.304113:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff473c00 x1874627750088192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784561.304125:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff473c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750088192:0@lo:400:kworker.0 00000100:00100000:3.0:1787784561.304341:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750088320 00000100:00100000:3.0:1787784561.304478:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750088320 00000100:00100000:3.0:1787784561.304541:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787784561.304550:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750088320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784561.304599:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750088320:12345-0@lo:400:kworker.0 Request processed in 50us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784561.304606:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1787784561.305437:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787784561.305445:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784561.305447:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784561.305568:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff470b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750088320:0@lo:400:kworker.0 00000100:00100000:1.0:1787784561.305791:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750088704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7084us (17703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784561.305801:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1787784561.305930:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339c780 x1874627750088704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784561.305950:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750088704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784561.956009:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784561.956056:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784561.956078:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784561.956104:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727993472 00000100:00100000:0.0:1787784561.956114:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727993472 00000100:00100000:0.0:1787784561.956168:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727993344 00000100:00100000:0.0:1787784561.956170:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727993344 00000100:00100000:0.0:1787784561.956187:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:0.0:1787784561.956195:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627727993472:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784561.956475:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727993216 00000100:00100000:1.0:1787784561.956480:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727993216 00000100:00100000:1.0:1787784561.956513:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 290 00000100:00100000:1.0:1787784561.956521:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2408:x1874627727993216:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784561.956581:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2408:x1874627727993216:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 60us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784561.956588:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 290 00000100:00100000:0.0:1787784561.956917:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627727993472:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 720us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784561.956925:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:0.0:1787784561.956941:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00100000:0.0:1787784561.956947:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff471680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727993344:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784561.956977:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff471680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727993344:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 30us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784561.956983:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00080000:3.0:1787784561.957447:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784561.957464:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787784562.197084:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784562.822799:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784562.822823:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff456d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750088832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784562.822905:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784562.824830:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750088832 00000100:00100000:3.0:1787784562.824845:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750088832 00000100:00100000:3.0:1787784562.824919:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787784562.824930:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750088832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784562.824972:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787784562.825064:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750088832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784562.825072:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787784562.838653:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff456d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750088832:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787784563.206102:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784564.235754:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784565.258586:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784565.896638:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784565.896663:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750088960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784565.896734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784565.896896:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750088960 00000100:00100000:2.0:1787784565.896903:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750088960 00000100:00100000:2.0:1787784565.896958:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787784565.896968:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750088960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784565.896997:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784565.897044:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750088960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784565.897051:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787784565.897114:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c23603c0 x1874627750088960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784565.897132:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750088960:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787784565.897476:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784565.897539:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784565.897549:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff455a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750089088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784565.897580:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784565.897678:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750089088 00000100:00100000:1.0:1787784565.897683:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750089088 00000100:00100000:1.0:1787784565.897711:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787784565.897717:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750089088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787784565.897728:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784565.897759:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750089088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784565.897799:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787784565.897814:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784565.897822:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750089216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784565.897851:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787784565.897950:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787784565.897971:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff455a40 x1874627750089088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784565.897985:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff455a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750089088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784565.898004:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750089216 00000100:00100000:3.0:1787784565.898008:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750089216 00000100:00100000:3.0:1787784565.898043:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787784565.898050:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f012f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750089216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787784565.898074:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787784565.898116:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f012f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750089216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784565.898123:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787784565.898436:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750089216:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787784566.285872:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784566.405985:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784566.405998:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750089472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784566.406004:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750089344:0@lo:400:kworker.0 00000100:00100000:3.0:1787784566.408911:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784566.409751:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750089344 00000100:00100000:0.0:1787784566.409762:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750089344 00000100:00100000:0.0:1787784566.409884:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787784566.409895:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750089344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784566.409978:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750089344:12345-0@lo:400:kworker.0 Request processed in 85us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784566.410001:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787784566.411439:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750089344:0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.411815:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff455a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750089856:0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.411906:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784566.411940:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750090368:0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.411965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784566.411987:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787784566.411993:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750089728:0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.412016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784566.412032:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff456d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750090240:0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.412050:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784566.412064:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750090752:0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.412084:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784566.412111:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750090368 00000100:00100000:1.0:1787784566.412117:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750090368 00000100:00100000:1.0:1787784566.412163:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750089728 00000100:00100000:1.0:1787784566.412166:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750089728 00000100:00100000:1.0:1787784566.412183:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750090240 00000100:00100000:1.0:1787784566.412186:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750090240 00000100:00100000:1.0:1787784566.412201:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787784566.412208:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750090368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.412267:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750090368:12345-0@lo:400:kworker.0 Request processed in 59us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784566.412274:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787784566.412290:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787784566.412296:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750089728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.412319:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750089728:12345-0@lo:400:kworker.0 Request processed in 24us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784566.412325:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787784566.412362:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787784566.412369:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750090240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.412395:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750090240:12345-0@lo:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784566.412400:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787784566.412424:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750090752 00000100:00100000:1.0:1787784566.412427:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750090752 00000100:00100000:1.0:1787784566.412454:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787784566.412461:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750090752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.412488:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750090752:12345-0@lo:400:kworker.0 Request processed in 29us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784566.412494:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787784566.412508:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784566.412512:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784566.412514:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784566.412544:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750089728:0@lo:400:kworker.0 00010000:00080000:1.0:1787784566.412555:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff456d00 x1874627750090240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784566.412576:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff456d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750090240:0@lo:400:kworker.0 00010000:00080000:1.0:1787784566.412587:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951e1eade00 x1874627750090752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784566.412595:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750090752:0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.412603:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750090368:0@lo:400:kworker.0 00000100:00100000:3.0:1787784566.413811:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750089856 00000100:00100000:3.0:1787784566.413820:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750089856 00000100:00100000:3.0:1787784566.413862:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787784566.413869:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750089856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784566.413931:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750089856:12345-0@lo:400:kworker.0 Request processed in 62us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784566.413938:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787784566.415160:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff455a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750089856:0@lo:400:kworker.0 00000100:00100000:3.0:1787784566.415337:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750089600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784566.415393:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784566.415431:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750090112:0@lo:400:kworker.0 00000100:00100000:3.0:1787784566.415456:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784566.415472:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750090624:0@lo:400:kworker.0 00000100:00100000:3.0:1787784566.415492:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784566.415513:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787784566.415520:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750089984:0@lo:400:kworker.0 00000100:00100000:3.0:1787784566.415540:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784566.415554:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff455680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750090496:0@lo:400:kworker.0 00000100:00100000:3.0:1787784566.415573:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784566.415640:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750089600 00000100:00100000:1.0:1787784566.415646:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750089600 00000100:00100000:1.0:1787784566.415763:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787784566.415788:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750089600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787784566.415816:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784566.415855:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750089600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784566.415863:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787784566.415885:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750090112 00000100:00100000:1.0:1787784566.415889:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750090112 00000100:00100000:1.0:1787784566.415913:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750089984 00000100:00100000:1.0:1787784566.415915:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750089984 00000100:00100000:1.0:1787784566.415929:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750090496 00000100:00100000:1.0:1787784566.415931:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750090496 00000100:00100000:1.0:1787784566.415945:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787784566.415952:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750090112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.415981:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750090112:12345-0@lo:400:kworker.0 Request processed in 30us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784566.416004:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787784566.416015:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787784566.416021:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750089984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.416045:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750089984:12345-0@lo:400:kworker.0 Request processed in 25us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784566.416051:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787784566.416060:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787784566.416066:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750090496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784566.416089:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750090496:12345-0@lo:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784566.416095:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1787784566.416162:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784566.416167:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784566.416169:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784566.416189:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750089984:0@lo:400:kworker.0 00010000:00080000:3.0:1787784566.416201:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff455680 x1874627750090496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784566.416218:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff455680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750090496:0@lo:400:kworker.0 00010000:00080000:3.0:1787784566.416228:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff4730c0 x1874627750089600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784566.416242:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750089600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784566.416251:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750090112:0@lo:400:kworker.0 00000100:00100000:0.0:1787784566.416321:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750090624 00000100:00100000:0.0:1787784566.416325:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750090624 00000100:00100000:0.0:1787784566.416366:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784566.416374:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750090624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784566.416453:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750090624:12345-0@lo:400:kworker.0 Request processed in 79us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784566.416459:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787784566.417621:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784566.418394:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750089472 00000100:00100000:0.0:1787784566.418402:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750089472 00000100:00100000:0.0:1787784566.418457:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787784566.418468:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750089472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784566.418491:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784566.418563:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750089472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784566.418571:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1787784566.418677:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339cf00 x1874627750089472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784566.418698:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750089472:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787784566.421061:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff4570c0 x1874627750090624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784566.421081:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750090624:0@lo:400:kworker.0 00000100:00100000:0.0:1787784567.077646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784567.077702:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784567.077744:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784567.077939:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727993600 00000100:00100000:2.0:1787784567.077949:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727993600 00000100:00100000:1.0:1787784567.078005:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727993728 00000100:00100000:2.0:1787784567.078008:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 292 00000100:00100000:1.0:1787784567.078009:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727993728 00000100:00100000:2.0:1787784567.078017:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2408:x1874627727993600:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784567.078047:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727993856 00000100:00100000:1.0:1787784567.078050:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727993856 00000100:00100000:1.0:1787784567.078069:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:1.0:1787784567.078076:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff470b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727993728:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784567.078091:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2408:x1874627727993600:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 76us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784567.078099:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 292 00000100:00100000:1.0:1787784567.078105:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff470b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727993728:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 31us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784567.078111:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:1.0:1787784567.078122:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:1.0:1787784567.078127:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff473c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627727993856:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784567.078152:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff473c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627727993856:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784567.078157:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00080000:3.0:1787784567.078548:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784567.078553:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787784567.305354:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784567.945499:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784567.945530:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750090880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784567.945615:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784567.947751:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750090880 00000100:00100000:3.0:1787784567.947801:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750090880 00000100:00100000:3.0:1787784567.947869:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787784567.947881:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750090880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784567.947921:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787784567.948014:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750090880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (2398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784567.948022:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787784567.949384:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750090880:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784568.330650:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787784569.165815:0:11998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 18:49:27 (1787784567) === 00010000:00010000:1.0:1787784569.357647:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784569.582500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784569.587207:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727993984 00000100:00100000:0.0:1787784569.587228:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727993984 00000100:00100000:2.0:1787784569.588053:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 293 00000100:00100000:2.0:1787784569.588069:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:8735:x1874627727993984:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787784569.588093:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784569.588156:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5a200/0x88ace7295d9ce27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e728e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784569.588198:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5a200/0x88ace7295d9ce27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728e1 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784569.588211:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5a200/0x88ace7295d9ce27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728e1 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784569.588221:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a200, rc 0) 00000100:00100000:2.0:1787784569.588325:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+11:8735:x1874627727993984:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 260us (5843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784569.588334:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 293 00000100:00100000:2.0:1787784569.601345:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784569.608346:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727994112 00000100:00100000:0.0:1787784569.608367:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727994112 00000100:00100000:1.0:1787784569.612591:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 294 00000100:00100000:1.0:1787784569.612612:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+11:8735:x1874627727994112:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787784569.614190:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+11:8735:x1874627727994112:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 1570us (12849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784569.614207:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 294 00000100:00100000:1.0:1787784569.621998:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784569.622282:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727994240 00000100:00100000:2.0:1787784569.622295:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727994240 00000100:00100000:2.0:1787784569.622379:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 295 00000100:00100000:2.0:1787784569.622392:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+11:8735:x1874627727994240:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787784569.622763:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+11:8735:x1874627727994240:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 372us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784569.622823:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 295 00000100:00100000:2.0:1787784569.638625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784569.639421:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727994368 00000100:00100000:1.0:1787784569.639437:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727994368 00000100:00100000:1.0:1787784569.639519:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 296 00000100:00100000:1.0:1787784569.639533:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+11:8739:x1874627727994368:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784569.639946:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+11:8739:x1874627727994368:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 414us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784569.639956:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 296 00000100:00100000:1.0:1787784569.673763:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784569.676070:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727994496 00000100:00100000:2.0:1787784569.676089:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727994496 00000100:00100000:2.0:1787784569.676191:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 297 00000100:00100000:2.0:1787784569.676204:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+11:8739:x1874627727994496:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787784569.676448:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+11:8739:x1874627727994496:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 245us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784569.676465:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 297 00000100:00100000:0.0:1787784569.682545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784569.685068:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727994624 00000100:00100000:1.0:1787784569.685089:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727994624 00000100:00100000:1.0:1787784569.685193:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 298 00000100:00100000:1.0:1787784569.685207:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+11:8739:x1874627727994624:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784569.685475:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+11:8739:x1874627727994624:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 269us (2947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784569.685486:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 298 00000100:00100000:1.0:1787784569.691938:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784569.692370:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727994752 00000100:00100000:0.0:1787784569.692383:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727994752 00000100:00100000:0.0:1787784569.692459:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 299 00000100:00100000:0.0:1787784569.692480:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+11:8735:x1874627727994752:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784569.692505:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784569.692530:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1629600/0x88ace7295d9ce2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72912 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784569.692568:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629600/0x88ace7295d9ce2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72912 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784569.692582:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1629600/0x88ace7295d9ce2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72912 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784569.692593:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629600, rc 0) 00000100:00100000:0.0:1787784569.692676:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+12:8735:x1874627727994752:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 199us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784569.692684:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 299 00000100:00100000:3.0:1787784569.697593:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784569.697720:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727994880 00000100:00100000:2.0:1787784569.697733:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727994880 00000100:00100000:0.0:1787784569.698000:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 300 00000100:00100000:0.0:1787784569.698016:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+12:8735:x1874627727994880:12345-192.168.202.41@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787784569.698054:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787784569.698087:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787784569.698092:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787784569.698096:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787784569.698099:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787784569.698102:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787784569.700744:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+12:8735:x1874627727994880:12345-192.168.202.41@tcp:256:mount.lustre.0 Request processed in 2716us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784569.700761:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 300 00000100:00100000:1.0:1787784569.706658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784569.707038:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727995008 00000100:00100000:2.0:1787784569.707052:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727995008 00000100:00100000:2.0:1787784569.707211:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 301 00000100:00100000:2.0:1787784569.707224:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+12:8735:x1874627727995008:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787784569.707248:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784569.707273:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5ac00/0x88ace7295d9ce35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72919 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784569.707326:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5ac00/0x88ace7295d9ce35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72919 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784569.707340:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5ac00/0x88ace7295d9ce35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72919 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784569.707354:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5ac00, rc 0) 00000100:00100000:2.0:1787784569.707549:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:8735:x1874627727995008:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 326us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784569.707557:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 301 00000100:00100000:3.0:1787784569.712464:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784569.715813:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727995136 00000100:00100000:0.0:1787784569.716097:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727995136 00000100:00100000:0.0:1787784569.716202:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 302 00000100:00100000:0.0:1787784569.716216:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:8735:x1874627727995136:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787784569.716454:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:8735:x1874627727995136:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 240us (4004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784569.716463:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 302 00000100:00100000:3.0:1787784569.718863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784569.719036:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727995264 00000100:00100000:2.0:1787784569.719049:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727995264 00000100:00100000:2.0:1787784569.719116:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 303 00000100:00100000:2.0:1787784569.719141:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:8735:x1874627727995264:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787784569.719358:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:8735:x1874627727995264:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 219us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784569.719379:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 303 00000100:00100000:1.0:1787784569.734217:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784569.734401:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727995392 00000100:00100000:0.0:1787784569.734416:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727995392 00000100:00100000:0.0:1787784569.734496:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 304 00000100:00100000:0.0:1787784569.734509:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:8743:x1874627727995392:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784569.734724:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:8743:x1874627727995392:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 217us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784569.734734:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 304 00000100:00100000:2.0:1787784569.742744:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784569.743850:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727995520 00000100:00100000:0.0:1787784569.743871:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727995520 00000100:00100000:0.0:1787784569.743960:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 305 00000100:00100000:0.0:1787784569.743974:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:8743:x1874627727995520:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784569.744207:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:8743:x1874627727995520:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 235us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784569.744216:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 305 00000100:00100000:3.0:1787784569.755269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784569.755362:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784569.755396:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784569.755468:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784569.758081:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727995648 00000100:00100000:2.0:1787784569.758101:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727995648 00000100:00100000:2.0:1787784569.758182:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727995904 00000100:00100000:2.0:1787784569.758186:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727995904 00000100:00100000:2.0:1787784569.758198:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727996288 00000100:00100000:2.0:1787784569.758201:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727996288 00000100:00100000:2.0:1787784569.758255:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727996416 00000100:00100000:2.0:1787784569.758259:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727996416 00000100:00100000:2.0:1787784569.758288:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 144 00000100:00100000:2.0:1787784569.758313:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5293840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627727996288:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784569.758436:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5293840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627727996288:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 137us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784569.758445:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 144 00000100:00100000:2.0:1787784569.758700:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00100000:2.0:1787784569.758709:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627727996416:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784569.758742:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627727996416:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 35us (3274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784569.758750:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00100000:2.0:1787784569.758763:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:2.0:1787784569.758794:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2404:x1874627727995648:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787784569.758950:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1e5cc6ee-e7bb-4eda-bff3-48f824501258@192.168.202.41@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:2.0:1787784569.758997:0:6523:0:(genops.c:1385:class_connect()) connect: client 1e5cc6ee-e7bb-4eda-bff3-48f824501258, cookie 0x88ace7295d9ce3c 00000004:00100000:2.0:1787784569.759031:0:6523:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787784569.765007:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:3.0:1787784569.765024:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2404:x1874627727995904:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787784569.765072:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 1e5cc6ee-e7bb-4eda-bff3-48f824501258@192.168.202.41@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:3.0:1787784569.765144:0:6522:0:(genops.c:1385:class_connect()) connect: client 1e5cc6ee-e7bb-4eda-bff3-48f824501258, cookie 0x88ace7295d9ce43 00000004:00100000:3.0:1787784569.765186:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787784569.765324:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8950c35ac000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784569.765416:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2404:x1874627727995904:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 392us (10052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784569.765425:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00080000:2.0:1787784569.766054:0:6523:0:(import.c:65:import_set_state_nolock()) ffff8950c344e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784569.766115:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2404:x1874627727995648:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 7344us (10860us total) trans 0 rc 0/0 00000100:00080000:3.0:1787784569.766294:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784569.766308:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784569.767268:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:1.0:1787784569.776338:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784569.776388:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784569.781003:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727996032 00000100:00100000:2.0:1787784569.781026:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727996032 00000100:00100000:2.0:1787784569.781714:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727995776 00000100:00100000:2.0:1787784569.781721:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727995776 00000100:00100000:3.0:1787784569.782087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784569.782126:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727996160 00000100:00100000:3.0:1787784569.782131:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727996160 00000100:00100000:3.0:1787784569.782167:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:3.0:1787784569.782178:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:0:x1874627727996032:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787784569.782232:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787784569.782297:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1787784569.782338:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5292580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+7:8735:x1874627727996160:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787784569.782362:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784569.782428:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5292580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+7:8735:x1874627727996160:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 93us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784569.782460:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:3.0:1787784569.782834:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:0:x1874627727996032:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 655us (6509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784569.782842:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00080000:1.0:1787784569.787341:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784569.787356:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784569.788007:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:2.0:1787784569.788026:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2363840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:0:x1874627727995776:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787784569.788074:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787784569.788811:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2363840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:0:x1874627727995776:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 785us (12416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784569.788823:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:1.0:1787784569.793474:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784569.793583:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727996544 00000100:00100000:0.0:1787784569.793597:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727996544 00000100:00100000:0.0:1787784569.793683:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:0.0:1787784569.793696:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:8735:x1874627727996544:12345-192.168.202.41@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787784569.793855:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:8735:x1874627727996544:12345-192.168.202.41@tcp:40:mount.lustre.0 Request processed in 161us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784569.793864:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:0.0:1787784569.796427:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784569.796476:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784569.796514:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784569.796551:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727996672 00000100:00100000:0.0:1787784569.796562:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727996672 00000100:00100000:0.0:1787784569.796603:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727996800 00000100:00100000:0.0:1787784569.796605:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727996800 00000100:00100000:0.0:1787784569.796626:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:0.0:1787784569.796635:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff470f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2404:x1874627727996672:12345-192.168.202.41@tcp:8:mount.lustre.0 00000100:00100000:3.0:1787784569.796794:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727996928 00000100:00100000:3.0:1787784569.796800:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727996928 00000100:00100000:3.0:1787784569.796844:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:3.0:1787784569.796852:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff473840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:8735:x1874627727996928:12345-192.168.202.41@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787784569.796947:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff473840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:8735:x1874627727996928:12345-192.168.202.41@tcp:900:mount.lustre.0 Request processed in 95us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784569.796973:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:1.0:1787784569.797078:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:1.0:1787784569.797086:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff472940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2404:x1874627727996800:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787784569.797123:0:8438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1e5cc6ee-e7bb-4eda-bff3-48f824501258@192.168.202.41@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:1.0:1787784569.797166:0:8438:0:(genops.c:1385:class_connect()) connect: client 1e5cc6ee-e7bb-4eda-bff3-48f824501258, cookie 0x88ace7295d9ce4a 00002000:00100000:1.0:1787784569.797182:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1e5cc6ee-e7bb-4eda-bff3-48f824501258/ffff8950c259b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787784569.797207:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787784569.797326:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787784569.797364:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8950c2599800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784569.797401:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff472940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2404:x1874627727996800:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 315us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784569.797408:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00010000:00080000:0.0:1787784569.797960:0:8916:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1e5cc6ee-e7bb-4eda-bff3-48f824501258@192.168.202.41@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:0.0:1787784569.797987:0:8916:0:(genops.c:1385:class_connect()) connect: client 1e5cc6ee-e7bb-4eda-bff3-48f824501258, cookie 0x88ace7295d9ce51 00002000:00100000:0.0:1787784569.797995:0:8916:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1e5cc6ee-e7bb-4eda-bff3-48f824501258/ffff8950c26ec800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784569.798012:0:8916:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787784569.798069:0:8916:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787784569.798088:0:8916:0:(import.c:65:import_set_state_nolock()) ffff8950c26ea000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784569.798984:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff470f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2404:x1874627727996672:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 2342us (2564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784569.799016:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:0.0:1787784569.802365:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784569.802798:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727997056 00000100:00100000:1.0:1787784569.802813:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727997056 00000100:00100000:0.0:1787784569.804202:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:0.0:1787784569.804227:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:8735:x1874627727997056:12345-192.168.202.41@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787784569.804385:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787784569.804521:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:8735:x1874627727997056:12345-192.168.202.41@tcp:33:mount.lustre.0 Request processed in 303us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784569.804529:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00010000:00010000:1.0:1787784570.375083:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784571.014227:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750091008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784571.014344:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784571.016891:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784571.016953:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750091136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784571.017306:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784571.017831:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750091136 00000100:00100000:1.0:1787784571.017843:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750091136 00000100:00100000:1.0:1787784571.018220:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787784571.018236:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750091136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784571.018272:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784571.018365:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750091136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784571.018383:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1787784571.018545:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787784571.019553:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff456580 x1874627750091136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784571.019586:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750091136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784571.020156:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750091008 00000100:00100000:3.0:1787784571.020166:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750091008 00000100:00100000:3.0:1787784571.020218:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787784571.020228:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750091008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787784571.020267:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787784571.020357:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750091008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (6015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784571.020365:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787784571.020705:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750091008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784571.024408:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750091264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784571.024582:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784571.026052:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750091264 00000100:00100000:0.0:1787784571.026082:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750091264 00000100:00100000:0.0:1787784571.026166:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787784571.026178:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750091264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784571.026213:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787784571.026342:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784571.029426:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750091264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3226us (4820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784571.029447:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1787784571.032721:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339c780 x1874627750091264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784571.032760:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750091264:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787784571.400580:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784571.526018:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750091392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784571.526130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784571.527454:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3411a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750091648:0@lo:400:kworker.0 00000100:00100000:2.0:1787784571.527518:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784571.527575:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750092160:0@lo:400:kworker.0 00000100:00100000:2.0:1787784571.527610:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784571.527637:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750091520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784571.527641:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750092672:0@lo:400:kworker.0 00000100:00100000:2.0:1787784571.527678:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784571.527873:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750091392 00000100:00100000:1.0:1787784571.527884:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750091392 00000100:00100000:1.0:1787784571.527963:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787784571.527977:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750091392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784571.528009:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784571.528092:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784571.528117:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750091904:0@lo:400:kworker.0 00000100:00100000:3.0:1787784571.528140:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3411680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750092032:0@lo:400:kworker.0 00000100:00100000:2.0:1787784571.528157:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784571.528183:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784571.528186:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750092416:0@lo:400:kworker.0 00000100:00100000:3.0:1787784571.528211:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750092544:0@lo:400:kworker.0 00000100:00100000:2.0:1787784571.528219:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784571.528245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784571.528247:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787784571.528256:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750091776:0@lo:400:kworker.0 00000100:00100000:2.0:1787784571.528297:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784571.528306:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750091520 00000100:00100000:3.0:1787784571.528311:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750091520 00000100:00100000:3.0:1787784571.528338:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787784571.528345:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750091520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787784571.528368:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784571.528404:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750091520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784571.528467:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787784571.528484:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750092288:0@lo:400:kworker.0 00000100:00100000:3.0:1787784571.528500:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750091904 00000100:00100000:3.0:1787784571.528505:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750091904 00000100:00100000:2.0:1787784571.528520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784571.528543:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787784571.528551:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750091904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784571.528556:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750091648 00000100:00100000:2.0:1787784571.528564:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750091648 00000100:00100000:3.0:1787784571.528609:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750091904:12345-0@lo:400:kworker.0 Request processed in 57us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784571.528609:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787784571.528623:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787784571.528625:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750091648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784571.528647:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750092160 00000100:00100000:3.0:1787784571.528652:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750092160 00000100:00100000:2.0:1787784571.528674:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750091648:12345-0@lo:400:kworker.0 Request processed in 53us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784571.528678:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750092032 00000100:00100000:2.0:1787784571.528684:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787784571.528698:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750092032 00000100:00100000:3.0:1787784571.528718:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750092416 00000100:00100000:3.0:1787784571.528720:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750092416 00000100:00100000:2.0:1787784571.528728:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750092544 00000100:00100000:2.0:1787784571.528734:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750092544 00000100:00100000:3.0:1787784571.528738:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750091776 00000100:00100000:3.0:1787784571.528742:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750091776 00000100:00100000:2.0:1787784571.528764:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750092288 00000100:00100000:3.0:1787784571.528783:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787784571.528789:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750092288 00000100:00100000:3.0:1787784571.528793:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3413c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750092160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784571.528819:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787784571.528827:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750092032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784571.529113:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787784571.529124:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750092416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784571.530576:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750092032:12345-0@lo:400:kworker.0 Request processed in 1739us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784571.530592:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787784571.530639:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787784571.530654:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750092544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784571.530722:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750092544:12345-0@lo:400:kworker.0 Request processed in 75us (2478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784571.530729:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787784571.530742:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787784571.530749:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750091776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784571.530798:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750091776:12345-0@lo:400:kworker.0 Request processed in 50us (2513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784571.530804:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787784571.530817:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787784571.530824:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750092288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784571.530854:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750092288:12345-0@lo:400:kworker.0 Request processed in 31us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784571.530860:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787784571.530924:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3411a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750091648:0@lo:400:kworker.0 00000100:00100000:2.0:1787784571.530945:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750092160:0@lo:400:kworker.0 00000100:00100000:1.0:1787784571.532279:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750091392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4296us (6141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784571.532305:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787784571.532359:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750092672 00000100:00100000:1.0:1787784571.532368:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750092672 00000100:00100000:1.0:1787784571.532427:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787784571.532436:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750092672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784571.532492:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750092672:12345-0@lo:400:kworker.0 Request processed in 57us (4813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784571.532499:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787784571.532519:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784571.532527:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784571.532531:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784571.533007:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750092416:12345-0@lo:400:kworker.0 Request processed in 3779us (4680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784571.533021:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00010000:00080000:1.0:1787784571.533508:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3412580 x1874627750092672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784571.533539:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750092672:0@lo:400:kworker.0 00000100:00100000:3.0:1787784571.534510:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3413c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750092160:12345-0@lo:400:kworker.0 Request processed in 5712us (6892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784571.534532:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787784571.534639:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750091776:0@lo:400:kworker.0 00010000:00080000:3.0:1787784571.534662:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3413840 x1874627750092288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784571.534715:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750092288:0@lo:400:kworker.0 00000100:00100000:3.0:1787784571.534734:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750091904:0@lo:400:kworker.0 00000100:00100000:3.0:1787784571.534748:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750092416:0@lo:400:kworker.0 00010000:00080000:3.0:1787784571.534790:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339c780 x1874627750091392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784571.534811:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750091392:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787784571.536573:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f52903c0 x1874627750091520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784571.536604:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750091520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784571.536623:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3411680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750092032:0@lo:400:kworker.0 00010000:00080000:3.0:1787784571.536638:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3410f00 x1874627750092544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784571.536647:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750092544:0@lo:400:kworker.0 00010000:00010000:1.0:1787784572.422439:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784573.061987:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784573.062023:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750092800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784573.062122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784573.062240:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750092800 00000100:00100000:2.0:1787784573.062250:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750092800 00000100:00100000:2.0:1787784573.062341:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787784573.062353:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750092800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787784573.062427:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787784573.062494:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750092800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784573.062503:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787784573.062573:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750092800:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787784573.447056:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784574.472860:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784575.268585:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784575.268637:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784575.268675:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784575.268710:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784575.268729:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784575.268753:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784575.268825:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784575.268858:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727997440 00000100:00100000:1.0:1787784575.268869:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727997440 00000100:00100000:1.0:1787784575.268943:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727997696 00000100:00100000:1.0:1787784575.268947:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727997696 00000100:00100000:1.0:1787784575.268963:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727997312 00000100:00100000:1.0:1787784575.268966:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727997312 00000100:00100000:1.0:1787784575.268980:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727997568 00000100:00100000:1.0:1787784575.268982:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727997568 00000100:00100000:1.0:1787784575.269001:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00100000:1.0:1787784575.269013:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff455680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627727997440:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784575.269114:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff455680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627727997440:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 102us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784575.269138:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00100000:1.0:1787784575.269159:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 153 00000100:00100000:1.0:1787784575.269165:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2408:x1874627727997696:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784575.269208:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2408:x1874627727997696:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 43us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784575.269215:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 153 00000100:00100000:1.0:1787784575.269227:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 154 00000100:00100000:1.0:1787784575.269233:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727997312:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784575.269275:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727997312:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 42us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784575.269282:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 154 00000100:00100000:1.0:1787784575.269293:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 155 00000100:00100000:1.0:1787784575.269300:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff456d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2408:x1874627727997568:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784575.269327:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff456d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2408:x1874627727997568:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 27us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784575.269334:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 155 00000100:00080000:1.0:1787784575.269357:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784575.269363:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787784575.269402:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727997952 00000100:00100000:1.0:1787784575.269406:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727997952 00000100:00100000:1.0:1787784575.269437:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727997824 00000100:00100000:1.0:1787784575.269440:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727997824 00000100:00100000:1.0:1787784575.269463:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:1.0:1787784575.269470:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff455a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2408:x1874627727997952:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784575.269500:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff455a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2408:x1874627727997952:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 30us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784575.269506:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:1.0:1787784575.269519:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:1.0:1787784575.269536:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2408:x1874627727997824:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784575.269567:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2408:x1874627727997824:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 33us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784575.269573:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00080000:1.0:1787784575.269609:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787784575.269612:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784575.270156:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727997184 00000100:00100000:2.0:1787784575.270163:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727997184 00000100:00100000:2.0:1787784575.270224:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 307 00000100:00100000:2.0:1787784575.270233:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627727997184:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784575.270296:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627727997184:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 63us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784575.270303:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 307 00010000:00010000:1.0:1787784575.499437:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787784575.627192:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1e5cc6ee-e7bb-4eda-bff3-48f824501258 00000001:00100000:0.0:1787784575.629166:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1e5cc6ee-e7bb-4eda-bff3-48f824501258 00000001:00100000:0.0:1787784575.629210:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1e5cc6ee-e7bb-4eda-bff3-48f824501258 00000001:00100000:3.0:1787784575.647812:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1e5cc6ee-e7bb-4eda-bff3-48f824501258 00000100:00100000:1.0:1787784576.136954:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784576.136984:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750092928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784576.137077:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784576.137597:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750092928 00000100:00100000:2.0:1787784576.137608:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750092928 00000100:00100000:2.0:1787784576.137676:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787784576.137688:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750092928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784576.137736:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787784576.137832:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750092928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784576.137840:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787784576.137870:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750093056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784576.137906:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784576.138005:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750093056 00000100:00100000:2.0:1787784576.138009:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750093056 00000100:00100000:2.0:1787784576.138060:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787784576.138066:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750093056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784576.138094:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784576.138130:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750093056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784576.138136:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787784576.139527:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784576.142013:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750093184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784576.142145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784576.143621:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750093184 00000100:00100000:1.0:1787784576.143640:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750093184 00000100:00100000:3.0:1787784576.143672:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750092928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784576.143719:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787784576.143729:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750093184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787784576.143762:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1787784576.152513:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3410f00 x1874627750093056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784576.152563:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750093056:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787784576.152668:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784576.160476:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750093184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 16733us (18316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784576.160496:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1787784576.160638:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3412940 x1874627750093184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784576.160699:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750093184:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1787784576.262575:0:12191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1787784576.528613:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784576.646090:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750093696:0@lo:400:kworker.0 00000100:00100000:1.0:1787784576.646090:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c33852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750093440:0@lo:400:kworker.0 00000100:00100000:0.0:1787784576.646176:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3384b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750093312:0@lo:400:kworker.0 00000100:00100000:2.0:1787784576.650477:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750093568:0@lo:400:kworker.0 00000100:00100000:3.0:1787784576.650650:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784576.650737:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750094208:0@lo:400:kworker.0 00000100:00100000:3.0:1787784576.650784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784576.650799:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750093696 00000100:00100000:1.0:1787784576.650810:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750093696 00000100:00100000:3.0:1787784576.650827:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750094720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784576.650858:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784576.650864:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750094208 00000100:00100000:1.0:1787784576.650866:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750094208 00000100:00100000:1.0:1787784576.650900:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787784576.650910:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750093696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784576.650991:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750093696:12345-0@lo:400:kworker.0 Request processed in 83us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784576.651023:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787784576.651044:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787784576.651051:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750094208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784576.651083:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750094208:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784576.651089:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787784576.651118:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750094720 00000100:00100000:1.0:1787784576.651122:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750094720 00000100:00100000:1.0:1787784576.651150:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787784576.651157:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f55c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750094720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784576.651188:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784576.651236:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f55c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750094720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784576.651253:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787784576.651481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784576.651509:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750093952:0@lo:400:kworker.0 00000100:00100000:1.0:1787784576.651670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784576.651690:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5316580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750094464:0@lo:400:kworker.0 00000100:00100000:1.0:1787784576.651717:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784576.651752:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750093440 00000100:00100000:1.0:1787784576.651756:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750093440 00000100:00100000:1.0:1787784576.651808:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750093952 00000100:00100000:1.0:1787784576.651811:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750093952 00000100:00100000:1.0:1787784576.651832:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787784576.651839:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750093440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784576.651876:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750093440:12345-0@lo:400:kworker.0 Request processed in 37us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784576.651892:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787784576.651907:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787784576.651913:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5317c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750093952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784576.651941:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5317c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750093952:12345-0@lo:400:kworker.0 Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784576.651947:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787784576.651966:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750094464 00000100:00100000:1.0:1787784576.651969:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750094464 00000100:00100000:1.0:1787784576.651994:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787784576.652001:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750094464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784576.652030:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750094464:12345-0@lo:400:kworker.0 Request processed in 30us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784576.652037:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787784576.652095:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c33852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750093440:0@lo:400:kworker.0 00010000:00080000:1.0:1787784576.652110:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f5315680 x1874627750093952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784576.652122:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750093952:0@lo:400:kworker.0 00010000:00080000:1.0:1787784576.652131:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f5316580 x1874627750094464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784576.652139:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5316580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750094464:0@lo:400:kworker.0 00000100:00080000:1.0:1787784576.652185:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784576.652191:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787784576.652440:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3412d00 x1874627750094720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784576.652458:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750094720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784576.652470:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750093696:0@lo:400:kworker.0 00010000:00080000:3.0:1787784576.652480:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f5314b40 x1874627750094208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784576.652488:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750094208:0@lo:400:kworker.0 00000100:00100000:0.0:1787784576.653217:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784576.653337:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750093824:0@lo:400:kworker.0 00000100:00100000:0.0:1787784576.653372:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784576.653402:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5316940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750094336:0@lo:400:kworker.0 00000100:00100000:0.0:1787784576.653427:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784576.653457:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750094336 00000100:00100000:0.0:1787784576.653462:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750094336 00000100:00100000:0.0:1787784576.653509:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784576.653516:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750094336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784576.653575:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750094336:12345-0@lo:400:kworker.0 Request processed in 59us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784576.653582:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787784576.653619:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f5316940 x1874627750094336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784576.653631:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5316940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750094336:0@lo:400:kworker.0 00000100:00100000:1.0:1787784576.654141:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750093824 00000100:00100000:1.0:1787784576.654147:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750093824 00000100:00100000:1.0:1787784576.654221:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787784576.654230:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750093824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784576.654292:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750093824:12345-0@lo:400:kworker.0 Request processed in 64us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784576.654299:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1787784576.654321:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784576.654326:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784576.654464:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750093824:0@lo:400:kworker.0 00000100:00100000:2.0:1787784576.654697:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784576.654785:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750094080:0@lo:400:kworker.0 00000100:00100000:2.0:1787784576.654816:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784576.654843:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750094592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784576.654868:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784576.654947:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750094592 00000100:00100000:1.0:1787784576.654952:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750094592 00000100:00100000:1.0:1787784576.654991:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787784576.655000:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750094592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787784576.655022:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784576.655065:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750094592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784576.655072:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787784576.655092:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750094080 00000100:00100000:1.0:1787784576.655096:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750094080 00000100:00100000:1.0:1787784576.655127:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787784576.655133:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750094080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784576.655167:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750094080:12345-0@lo:400:kworker.0 Request processed in 34us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784576.655173:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:1.0:1787784576.655326:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784576.655401:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750094080:0@lo:400:kworker.0 00010000:00080000:2.0:1787784576.655415:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951e1ffed00 x1874627750094592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784576.655433:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750094592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784576.655599:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750093312 00000100:00100000:3.0:1787784576.655605:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750093312 00000100:00100000:3.0:1787784576.655697:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787784576.655706:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750093312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784576.655789:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750093312:12345-0@lo:400:kworker.0 Request processed in 85us (2574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784576.655797:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787784576.655896:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3384b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750093312:0@lo:400:kworker.0 00000100:00100000:0.0:1787784576.661368:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750093568 00000100:00100000:0.0:1787784576.661390:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750093568 00000100:00100000:0.0:1787784576.661493:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787784576.661506:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3413840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750093568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784576.661742:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3413840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750093568:12345-0@lo:400:kworker.0 Request processed in 238us (7043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784576.661751:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787784576.664080:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750093568:0@lo:400:kworker.0 00010000:00010000:0.0:1787784577.545678:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784578.182098:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784578.199548:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750094848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784578.201106:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784578.203840:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750094848 00000100:00100000:0.0:1787784578.203864:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750094848 00000100:00100000:0.0:1787784578.203947:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787784578.203959:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5316580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750094848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784578.204015:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784578.204141:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5316580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750094848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 184us (3043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784578.204150:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787784578.207568:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750094848:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784578.566008:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784579.592583:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784580.384033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784580.384096:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784580.384141:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784580.384168:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784580.384192:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784580.384224:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784580.384245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784580.384271:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727998336 00000100:00100000:1.0:1787784580.384282:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727998336 00000100:00100000:1.0:1787784580.384346:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727998592 00000100:00100000:1.0:1787784580.384349:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727998592 00000100:00100000:1.0:1787784580.384364:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727998208 00000100:00100000:1.0:1787784580.384366:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727998208 00000100:00100000:1.0:1787784580.384378:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727998464 00000100:00100000:1.0:1787784580.384380:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727998464 00000100:00100000:1.0:1787784580.384396:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:1.0:1787784580.384406:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627727998336:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784580.384656:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727998080 00000100:00100000:2.0:1787784580.384660:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727998080 00000100:00100000:2.0:1787784580.384696:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 309 00000100:00100000:2.0:1787784580.384703:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2407:x1874627727998080:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784580.384751:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2407:x1874627727998080:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 48us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784580.384762:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 309 00000100:00100000:1.0:1787784580.384939:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627727998336:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 214us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784580.384946:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:1.0:1787784580.385312:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:1.0:1787784580.385327:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5316d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627727998592:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784580.385366:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5316d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627727998592:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 43us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784580.385372:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:1.0:1787784580.385386:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:1.0:1787784580.385393:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5315680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2407:x1874627727998208:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784580.385744:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5315680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2407:x1874627727998208:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 351us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784580.385751:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:1.0:1787784580.385799:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:1.0:1787784580.385808:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627727998464:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784580.385838:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627727998464:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 32us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784580.385844:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:1.0:1787784580.386107:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727998848 00000100:00100000:1.0:1787784580.386113:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727998848 00000100:00080000:0.0:1787784580.386409:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784580.386417:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784580.386420:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784580.386433:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727998720 00000100:00100000:0.0:1787784580.386437:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727998720 00000100:00100000:0.0:1787784580.386482:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:0.0:1787784580.386489:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627727998720:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784580.386524:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627727998720:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 36us (2278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784580.386530:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:1.0:1787784580.387017:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:1.0:1787784580.387025:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627727998848:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784580.387069:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627727998848:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 45us (2900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784580.387076:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00080000:2.0:1787784580.387178:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787784580.620398:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784581.254757:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff471e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750094976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784581.254861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784581.255755:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750094976 00000100:00100000:0.0:1787784581.255793:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750094976 00000100:00100000:0.0:1787784581.255893:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787784581.255905:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750094976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784581.255939:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784581.255986:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750095104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784581.256006:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750094976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784581.256028:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784581.256032:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787784581.256052:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750095104 00000100:00100000:0.0:1787784581.256056:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750095104 00000100:00100000:0.0:1787784581.256078:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787784581.256085:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750095104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784581.256097:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784581.256150:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750095104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784581.256157:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1787784581.256205:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff471e00 x1874627750094976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784581.256225:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff471e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750094976:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787784581.256281:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff454000 x1874627750095104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784581.256296:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750095104:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787784581.256617:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784581.256793:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784581.256804:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750095232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784581.256840:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784581.256940:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750095232 00000100:00100000:1.0:1787784581.256945:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750095232 00000100:00100000:1.0:1787784581.256975:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787784581.256982:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff471e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750095232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784581.257016:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787784581.257056:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff471e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750095232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784581.257076:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787784581.257422:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750095232:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787784581.638181:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784581.770019:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784581.770056:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750095360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784581.770165:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784581.770284:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750095360 00000100:00100000:3.0:1787784581.770295:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750095360 00000100:00100000:3.0:1787784581.770376:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787784581.770388:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750095360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784581.770430:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784581.770487:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750095360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784581.770505:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1787784581.770531:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787784581.770574:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff454000 x1874627750095360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784581.770596:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750095360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784581.771474:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff457840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750095744:0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.771543:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784581.771573:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750096256:0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.771598:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784581.771632:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750096768:0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.771652:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784581.771672:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787784581.771677:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750095616:0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.771700:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784581.771718:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750096128:0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.771739:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784581.771756:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750096640:0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.771808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784581.771861:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750095744 00000100:00100000:3.0:1787784581.771868:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750095744 00000100:00100000:3.0:1787784581.771907:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787784581.771916:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750095744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.771969:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750095744:12345-0@lo:400:kworker.0 Request processed in 53us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784581.771976:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787784581.771996:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750096256 00000100:00100000:3.0:1787784581.772000:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750096256 00000100:00100000:3.0:1787784581.772029:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750096768 00000100:00100000:3.0:1787784581.772032:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750096768 00000100:00100000:3.0:1787784581.772046:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750095616 00000100:00100000:3.0:1787784581.772049:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750095616 00000100:00100000:3.0:1787784581.772061:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750096128 00000100:00100000:3.0:1787784581.772063:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750096128 00000100:00100000:3.0:1787784581.772076:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750096640 00000100:00100000:3.0:1787784581.772078:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750096640 00000100:00100000:3.0:1787784581.772092:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787784581.772098:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750096256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.772142:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750096256:12345-0@lo:400:kworker.0 Request processed in 44us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784581.772149:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787784581.772161:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787784581.772167:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750096768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.772205:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750096768:12345-0@lo:400:kworker.0 Request processed in 38us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784581.772211:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787784581.772222:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787784581.772228:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750095616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.772257:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750095616:12345-0@lo:400:kworker.0 Request processed in 30us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784581.772263:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787784581.772276:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787784581.772282:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750096128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.772310:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750096128:12345-0@lo:400:kworker.0 Request processed in 28us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784581.772315:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787784581.772325:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787784581.772331:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750096640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.772358:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750096640:12345-0@lo:400:kworker.0 Request processed in 27us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784581.772363:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787784581.772418:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750095616:0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.772441:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750096128:0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.772451:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750096640:0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.772461:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff457840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750095744:0@lo:400:kworker.0 00010000:00080000:3.0:1787784581.772472:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339e1c0 x1874627750096256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784581.772483:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750096256:0@lo:400:kworker.0 00010000:00080000:3.0:1787784581.772493:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339c000 x1874627750096768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784581.772501:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750096768:0@lo:400:kworker.0 00000100:00080000:3.0:1787784581.772532:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784581.772537:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787784581.772619:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750095872:0@lo:400:kworker.0 00000100:00100000:1.0:1787784581.772660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784581.772692:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750096384:0@lo:400:kworker.0 00000100:00100000:1.0:1787784581.772720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784581.772742:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750096896:0@lo:400:kworker.0 00000100:00100000:1.0:1787784581.772764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784581.772817:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787784581.772824:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750095488:0@lo:400:kworker.0 00000100:00100000:1.0:1787784581.772857:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784581.772878:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750096000:0@lo:400:kworker.0 00000100:00100000:1.0:1787784581.772902:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784581.772917:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750096512:0@lo:400:kworker.0 00000100:00100000:1.0:1787784581.772938:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784581.772955:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750097024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784581.772977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784581.773009:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750096384 00000100:00100000:1.0:1787784581.773013:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750096384 00000100:00100000:1.0:1787784581.773051:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750096896 00000100:00100000:1.0:1787784581.773054:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750096896 00000100:00100000:1.0:1787784581.773073:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750096512 00000100:00100000:1.0:1787784581.773076:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750096512 00000100:00100000:1.0:1787784581.773097:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787784581.773106:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3387840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750096384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784581.773151:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3387840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750096384:12345-0@lo:400:kworker.0 Request processed in 46us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784581.773167:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787784581.773182:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787784581.773188:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c33852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750096896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784581.773232:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c33852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750096896:12345-0@lo:400:kworker.0 Request processed in 44us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784581.773238:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787784581.773249:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787784581.773256:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750096512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784581.773286:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750096512:12345-0@lo:400:kworker.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784581.773292:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787784581.773319:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750097024 00000100:00100000:1.0:1787784581.773323:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750097024 00000100:00100000:1.0:1787784581.773345:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787784581.773352:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2361a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750097024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787784581.773369:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784581.773400:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2361a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750097024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784581.773406:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1787784581.773439:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339d680 x1874627750096512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784581.773451:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750096512:0@lo:400:kworker.0 00010000:00080000:1.0:1787784581.773461:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339d2c0 x1874627750097024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784581.773488:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750097024:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787784581.773500:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339f840 x1874627750096384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784581.773508:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750096384:0@lo:400:kworker.0 00010000:00080000:1.0:1787784581.773516:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339fc00 x1874627750096896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784581.773523:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750096896:0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.775057:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750095872 00000100:00100000:3.0:1787784581.775071:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750095872 00000100:00100000:3.0:1787784581.775144:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787784581.775155:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750095872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.775310:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750095872:12345-0@lo:400:kworker.0 Request processed in 157us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784581.775318:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787784581.775345:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750095488 00000100:00100000:3.0:1787784581.775349:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750095488 00000100:00100000:3.0:1787784581.775382:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787784581.775389:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750095488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.775426:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750095488:12345-0@lo:400:kworker.0 Request processed in 37us (2568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784581.775451:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787784581.775492:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750096000 00000100:00100000:3.0:1787784581.775497:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750096000 00000100:00100000:3.0:1787784581.775525:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787784581.775532:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750096000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784581.775571:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750096000:12345-0@lo:400:kworker.0 Request processed in 39us (2667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784581.775577:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1787784581.775596:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784581.784023:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750095872:0@lo:400:kworker.0 00000100:00100000:0.0:1787784581.784389:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750095488:0@lo:400:kworker.0 00000100:00100000:0.0:1787784581.784410:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750096000:0@lo:400:kworker.0 00010000:00010000:0.0:1787784582.662052:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784583.303190:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750097152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784583.303334:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784583.303670:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750097152 00000100:00100000:1.0:1787784583.303679:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750097152 00000100:00100000:1.0:1787784583.303734:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787784583.303745:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750097152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787784583.303813:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787784583.303891:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750097152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784583.303899:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787784583.304677:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750097152:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784583.688841:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787784584.670354:0:12507:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787784584.670572:0:12507:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787784584.714520:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784585.512896:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784585.512962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784585.512983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784585.513001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784585.513019:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784585.513043:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727998976 00000100:00100000:1.0:1787784585.513052:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727998976 00000100:00100000:1.0:1787784585.513101:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 311 00000100:00100000:1.0:1787784585.513116:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627727998976:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784585.513185:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627727998976:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 70us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784585.513192:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 311 00000100:00100000:1.0:1787784585.513221:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727999744 00000100:00100000:1.0:1787784585.513224:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727999744 00000100:00100000:1.0:1787784585.513252:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:1.0:1787784585.513258:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627727999744:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784585.513283:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627727999744:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784585.513289:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:3.0:1787784585.523962:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727999232 00000100:00100000:3.0:1787784585.523978:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727999232 00000100:00100000:3.0:1787784585.524040:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727999488 00000100:00100000:3.0:1787784585.524044:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727999488 00000100:00100000:1.0:1787784585.524114:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727999104 00000100:00100000:1.0:1787784585.524119:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727999104 00000100:00100000:1.0:1787784585.524153:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 172 00000100:00100000:2.0:1787784585.524268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784585.524329:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784585.524348:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727999616 00000100:00100000:2.0:1787784585.524350:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727999616 00000100:00100000:2.0:1787784585.524376:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:2.0:1787784585.524382:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627727999616:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784585.524480:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627727999232:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784585.524490:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727999360 00000100:00100000:3.0:1787784585.524495:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727999360 00000100:00100000:3.0:1787784585.524515:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 173 00000100:00100000:3.0:1787784585.524521:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727999104:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784585.524546:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627727999232:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 374us (11582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784585.524551:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627727999104:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 29us (11529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784585.524558:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 172 00000100:00100000:3.0:1787784585.525232:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 173 00000100:00100000:1.0:1787784585.525242:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 174 00000100:00100000:1.0:1787784585.525254:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627727999488:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784585.525257:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 175 00000100:00100000:3.0:1787784585.525269:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627727999360:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784585.525301:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627727999360:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 35us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784585.525305:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 175 00000100:00080000:3.0:1787784585.525330:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787784585.525344:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784585.525346:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784585.525348:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784585.525354:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627727999488:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 100us (12366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784585.525363:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 174 00000100:00100000:2.0:1787784585.530899:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627727999616:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 6504us (6556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784585.530915:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00010000:00010000:0.0:1787784585.734821:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784586.374936:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750097280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784586.375053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784586.376444:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750097280 00000100:00100000:3.0:1787784586.376455:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750097280 00000100:00100000:3.0:1787784586.376523:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787784586.376534:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750097280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784586.376569:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784586.376637:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750097280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784586.376644:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787784586.376663:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787784586.376689:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53c8000 x1874627750097280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784586.376709:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750097280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784586.377299:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750097536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784586.377342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784586.377376:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784586.377383:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750097408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784586.377406:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784586.377441:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750097408 00000100:00100000:2.0:1787784586.377445:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750097408 00000100:00100000:2.0:1787784586.377477:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787784586.377485:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750097408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784586.377509:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787784586.377555:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750097408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784586.377561:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787784586.377592:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750097408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784586.377658:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750097536 00000100:00100000:1.0:1787784586.377668:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750097536 00000100:00100000:1.0:1787784586.377714:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787784586.377721:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750097536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784586.377733:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784586.377785:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750097536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784586.377792:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787784586.377938:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787784586.377959:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3410000 x1874627750097536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784586.377973:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750097536:0@lo:13:osp-pre-0-0.0 00000020:00000004:1.0:1787784586.740216:0:12605:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787784586.740455:0:12605:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787784586.762491:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784586.889505:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750097664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784586.889584:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784586.889666:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750097664 00000100:00100000:3.0:1787784586.889673:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750097664 00000100:00100000:3.0:1787784586.889727:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787784586.889737:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5316940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750097664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787784586.889795:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784586.889843:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5316940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750097664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784586.889851:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1787784586.889904:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53c8000 x1874627750097664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784586.889923:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750097664:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787784586.890425:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784586.890450:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750097792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784586.890488:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784586.890912:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750097792 00000100:00100000:1.0:1787784586.890918:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750097792 00000100:00100000:1.0:1787784586.890961:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787784586.890970:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750097792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784586.890987:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784586.891097:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750097792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784586.891105:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787784586.891293:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750097920:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.891328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784586.891366:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750098432:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.891391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784586.891409:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750098944:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.891430:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784586.891451:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787784586.891457:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750098048:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.891480:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784586.891499:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750098560:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.891517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784586.891529:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750099072:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.891544:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787784586.891577:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784586.891587:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750098432 00000100:00100000:2.0:1787784586.891590:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750098432 00000100:00100000:2.0:1787784586.891615:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787784586.891621:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750098432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.891656:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750098432:12345-0@lo:400:kworker.0 Request processed in 35us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784586.891662:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787784586.891677:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750098944 00000100:00100000:2.0:1787784586.891680:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750098944 00000100:00100000:2.0:1787784586.891702:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787784586.891708:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750098944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.891733:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750098944:12345-0@lo:400:kworker.0 Request processed in 25us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784586.891738:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787784586.891759:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750098304:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.891801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784586.891817:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750098816:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.891833:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787784586.891856:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3410f00 x1874627750097792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784586.891873:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750097792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784586.891886:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787784586.891891:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750098176:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.891909:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784586.891922:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750098688:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.891946:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784586.891960:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750099200:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.891975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784586.891993:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750098048 00000100:00100000:2.0:1787784586.891996:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750098048 00000100:00100000:2.0:1787784586.892014:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750098560 00000100:00100000:2.0:1787784586.892016:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750098560 00000100:00100000:1.0:1787784586.892716:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750097920 00000100:00100000:1.0:1787784586.892724:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750097920 00000100:00100000:3.0:1787784586.894570:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750099072 00000100:00100000:3.0:1787784586.894591:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750099072 00000100:00100000:3.0:1787784586.894639:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750098304 00000100:00100000:3.0:1787784586.894642:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750098304 00000100:00100000:3.0:1787784586.894653:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750098688 00000100:00100000:3.0:1787784586.894656:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750098688 00000100:00100000:3.0:1787784586.894669:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750099200 00000100:00100000:3.0:1787784586.894671:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750099200 00000100:00100000:3.0:1787784586.894688:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787784586.894696:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750098048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784586.894794:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750098048:12345-0@lo:400:kworker.0 Request processed in 99us (3312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784586.894801:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787784586.894819:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787784586.894826:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750099072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784586.894856:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750099072:12345-0@lo:400:kworker.0 Request processed in 31us (3310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784586.894862:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787784586.894875:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787784586.894880:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750098304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784586.894915:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750098304:12345-0@lo:400:kworker.0 Request processed in 35us (3113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784586.894921:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787784586.894932:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787784586.894950:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750098688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784586.894978:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750098688:12345-0@lo:400:kworker.0 Request processed in 30us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784586.894984:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787784586.894995:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787784586.895000:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750099200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784586.895022:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750099200:12345-0@lo:400:kworker.0 Request processed in 23us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784586.895028:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:3.0:1787784586.895050:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784586.895054:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787784586.895091:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3273c00 x1874627750098688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784586.895107:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750098688:0@lo:400:kworker.0 00010000:00080000:3.0:1787784586.895119:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f534d2c0 x1874627750099200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784586.895128:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750099200:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.895270:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787784586.895278:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750098560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.895313:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750098560:12345-0@lo:400:kworker.0 Request processed in 36us (3795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784586.895319:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787784586.895339:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750098816 00000100:00100000:2.0:1787784586.895343:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750098816 00000100:00100000:2.0:1787784586.895368:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787784586.895374:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750098816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.895403:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750098816:12345-0@lo:400:kworker.0 Request processed in 29us (3569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784586.895409:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787784586.895430:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750098176 00000100:00100000:2.0:1787784586.895433:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750098176 00000100:00100000:2.0:1787784586.895450:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787784586.895456:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750098176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.895483:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750098176:12345-0@lo:400:kworker.0 Request processed in 28us (3573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784586.895489:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787784586.895519:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750098048:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.895538:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750098560:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.895547:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750099072:0@lo:400:kworker.0 00000100:00100000:2.0:1787784586.895558:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750098432:0@lo:400:kworker.0 00010000:00080000:2.0:1787784586.895569:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f534c3c0 x1874627750098944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784586.895579:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750098944:0@lo:400:kworker.0 00000100:00100000:1.0:1787784586.897067:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787784586.897086:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750097920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784586.898393:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750098304:0@lo:400:kworker.0 00010000:00080000:3.0:1787784586.898427:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3270f00 x1874627750098816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784586.898439:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750098816:0@lo:400:kworker.0 00000100:00100000:3.0:1787784586.898474:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750098176:0@lo:400:kworker.0 00000100:00080000:3.0:1787784586.898509:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784586.900325:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750097920:12345-0@lo:400:kworker.0 Request processed in 3239us (8987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784586.900339:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787784586.909413:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750097920:0@lo:400:kworker.0 00010000:00010000:2.0:1787784587.782237:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784588.424564:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750099328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784588.424642:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784588.424884:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750099328 00000100:00100000:2.0:1787784588.424893:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750099328 00000100:00100000:2.0:1787784588.424943:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787784588.424953:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750099328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787784588.425002:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787784588.425438:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750099328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 485us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784588.425448:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787784588.426503:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750099328:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787784588.810440:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787784588.974138:0:12702:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787784588.974364:0:12702:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787784589.830482:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784590.642518:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784590.642574:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784590.642603:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784590.642621:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784590.642645:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784590.642669:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784590.642754:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784590.642828:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728000000 00000100:00100000:3.0:1787784590.642841:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728000000 00000100:00100000:3.0:1787784590.642918:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728000256 00000100:00100000:3.0:1787784590.642921:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728000256 00000100:00100000:3.0:1787784590.642939:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728000128 00000100:00100000:3.0:1787784590.642941:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728000128 00000100:00100000:3.0:1787784590.642957:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728000384 00000100:00100000:3.0:1787784590.642959:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728000384 00000100:00100000:3.0:1787784590.642976:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 182 00000100:00100000:3.0:1787784590.642987:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2407:x1874627728000000:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784590.643084:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2407:x1874627728000000:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 98us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784590.643093:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 182 00000100:00100000:3.0:1787784590.643124:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 183 00000100:00100000:3.0:1787784590.643132:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728000256:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784590.643403:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728000256:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 271us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784590.643411:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 183 00000100:00100000:3.0:1787784590.643427:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:3.0:1787784590.643434:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728000128:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784590.644056:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728000128:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 47us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784590.644067:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:3.0:1787784590.644087:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:3.0:1787784590.644098:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728000384:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784590.644149:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728000384:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 54us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784590.644156:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:3.0:1787784590.644202:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728000512 00000100:00100000:3.0:1787784590.644209:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728000512 00000100:00100000:3.0:1787784590.644255:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728000640 00000100:00100000:3.0:1787784590.644258:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728000640 00000100:00100000:3.0:1787784590.644355:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:3.0:1787784590.644363:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2404:x1874627728000512:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:3.0:1787784590.644389:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9ce51 00000100:00080000:3.0:1787784590.644400:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8950c26ea000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787784590.644456:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787784590.644490:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627727999872 00000100:00100000:0.0:1787784590.644497:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627727999872 00000100:00100000:0.0:1787784590.644537:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 313 00000100:00100000:0.0:1787784590.644547:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2407:x1874627727999872:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784590.644584:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2407:x1874627727999872:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 40us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784590.644592:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 313 00000100:00100000:3.0:1787784590.644634:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+2:2404:x1874627728000512:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 270us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784590.644642:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:3.0:1787784590.644659:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:3.0:1787784590.644667:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2404:x1874627728000640:12345-192.168.202.41@tcp:9:kworker.0 00000100:00080000:0.0:1787784590.644674:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784590.644680:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1787784590.644681:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9ce4a 00000100:00080000:0.0:1787784590.644684:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784590.644690:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8950c2599800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1787784590.644690:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787784590.644719:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787784590.644721:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1787784590.644736:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784590.644878:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+2:2404:x1874627728000640:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 211us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784590.644886:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00010000:00010000:1.0:1787784590.854292:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787784591.370592:0:12799:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787784591.371250:0:12799:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787784591.506983:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784591.507021:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750099456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787784591.507309:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784591.507321:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750099584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784591.507365:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784591.507460:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750099584 00000100:00100000:1.0:1787784591.507471:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750099584 00000100:00100000:1.0:1787784591.507539:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787784591.507551:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750099584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784591.507591:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784591.507643:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750099584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784591.507651:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1787784591.507702:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36a43c0 x1874627750099584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784591.507726:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750099584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784591.507811:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750099712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784591.507871:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787784591.507917:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784591.513423:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750099712 00000100:00100000:1.0:1787784591.513444:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750099712 00000100:00100000:1.0:1787784591.513528:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787784591.513540:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750099712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784591.513590:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787784591.513707:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750099712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 169us (5836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784591.513715:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787784591.513809:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750099712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784591.523429:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784591.523746:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750099456 00000100:00100000:2.0:1787784591.523758:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750099456 00000100:00100000:2.0:1787784591.523949:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787784591.523963:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750099456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784591.523998:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787784591.524308:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784591.524337:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750099456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784591.524348:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1787784591.526349:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c19f4b40 x1874627750099456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784591.526399:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750099456:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787784591.878749:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784592.005899:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750099840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784592.005973:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784592.006046:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750099840 00000100:00100000:0.0:1787784592.006053:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750099840 00000100:00100000:0.0:1787784592.006114:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787784592.006123:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750099840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784592.006152:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784592.006211:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750099840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784592.006218:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1787784592.006239:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787784592.006268:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36a61c0 x1874627750099840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784592.006287:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750099840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784592.006647:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750100096:0@lo:400:kworker.0 00000100:00100000:1.0:1787784592.006680:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784592.006709:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750100608:0@lo:400:kworker.0 00000100:00100000:1.0:1787784592.006731:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784592.006746:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750101120:0@lo:400:kworker.0 00000100:00100000:1.0:1787784592.006783:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784592.006809:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787784592.006815:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750099968:0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.007038:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750100224:0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.007069:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784592.007090:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750100736:0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.007123:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784592.007142:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750101248:0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.007164:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784592.007303:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750100096 00000100:00100000:3.0:1787784592.007375:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750100096 00000100:00100000:3.0:1787784592.007404:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750100608 00000100:00100000:3.0:1787784592.007407:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750100608 00000100:00100000:3.0:1787784592.007425:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750101120 00000100:00100000:3.0:1787784592.007428:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750101120 00000100:00100000:3.0:1787784592.007439:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750100736 00000100:00100000:3.0:1787784592.007441:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750100736 00000100:00100000:3.0:1787784592.007451:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750101248 00000100:00100000:3.0:1787784592.007453:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750101248 00000100:00100000:3.0:1787784592.007466:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787784592.007473:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750100096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.007521:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787784592.007528:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750100352:0@lo:400:kworker.0 00000100:00100000:3.0:1787784592.007628:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750100096:12345-0@lo:400:kworker.0 Request processed in 154us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784592.007635:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787784592.007649:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787784592.007656:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff488780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750100608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784592.007697:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff488780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750100608:12345-0@lo:400:kworker.0 Request processed in 42us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784592.007703:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787784592.007714:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787784592.007720:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750101120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784592.007747:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750101120:12345-0@lo:400:kworker.0 Request processed in 28us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784592.007753:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787784592.007764:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787784592.007786:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750100736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784592.007815:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750100736:12345-0@lo:400:kworker.0 Request processed in 31us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784592.007841:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787784592.007854:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787784592.007861:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750101248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784592.007890:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750101248:12345-0@lo:400:kworker.0 Request processed in 30us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784592.007895:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787784592.008330:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784592.008350:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750100864:0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.008378:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784592.008404:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750101376:0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.008425:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787784592.008459:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f534ed00 x1874627750100736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784592.008472:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750100736:0@lo:400:kworker.0 00010000:00080000:0.0:1787784592.008483:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53c8000 x1874627750101248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784592.008491:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750101248:0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.008520:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750100224 00000100:00100000:0.0:1787784592.008524:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750100224 00000100:00100000:0.0:1787784592.008556:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787784592.008562:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750100224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.008599:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750100224:12345-0@lo:400:kworker.0 Request processed in 37us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784592.008605:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787784592.008623:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750100352 00000100:00100000:0.0:1787784592.008626:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750100352 00000100:00100000:0.0:1787784592.008646:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787784592.008651:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750100352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.008682:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750100352:12345-0@lo:400:kworker.0 Request processed in 30us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784592.008688:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787784592.008716:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c339e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750101504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784592.008742:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784592.008795:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750100864 00000100:00100000:0.0:1787784592.008799:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750100864 00000100:00100000:0.0:1787784592.008833:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750101376 00000100:00100000:0.0:1787784592.008837:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750101376 00000100:00100000:0.0:1787784592.008860:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787784592.008867:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750100864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.008898:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750100864:12345-0@lo:400:kworker.0 Request processed in 31us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784592.008904:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787784592.008914:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787784592.008920:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750101376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.008947:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750101376:12345-0@lo:400:kworker.0 Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784592.008953:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787784592.008978:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750101504 00000100:00100000:0.0:1787784592.008982:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750101504 00000100:00100000:0.0:1787784592.009003:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787784592.009009:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750101504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787784592.009023:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784592.009057:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750101504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784592.009064:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1787784592.009086:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784592.009090:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787784592.009093:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787784592.009126:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c339e1c0 x1874627750101504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784592.009147:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c339e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750101504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784592.009183:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750100352:0@lo:400:kworker.0 00010000:00080000:0.0:1787784592.009193:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f534d2c0 x1874627750100864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784592.009201:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750100864:0@lo:400:kworker.0 00010000:00080000:0.0:1787784592.009209:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951e1ffcf00 x1874627750101376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784592.009216:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750101376:0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.009226:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750100224:0@lo:400:kworker.0 00000100:00100000:1.0:1787784592.009486:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784592.009567:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750100480:0@lo:400:kworker.0 00000100:00100000:1.0:1787784592.009597:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784592.009621:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750100992:0@lo:400:kworker.0 00000100:00100000:1.0:1787784592.009641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784592.009676:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750100096:0@lo:400:kworker.0 00000100:00100000:1.0:1787784592.009687:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750100608:0@lo:400:kworker.0 00000100:00100000:1.0:1787784592.009697:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750101120:0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.009836:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750100480 00000100:00100000:0.0:1787784592.009841:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750100480 00000100:00100000:0.0:1787784592.009873:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787784592.009881:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750100480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.009943:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750100480:12345-0@lo:400:kworker.0 Request processed in 61us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784592.009953:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787784592.009979:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750100992 00000100:00100000:0.0:1787784592.009985:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750100992 00000100:00100000:0.0:1787784592.010018:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787784592.010028:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750100992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784592.010075:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750100992:12345-0@lo:400:kworker.0 Request processed in 49us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784592.010082:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787784592.010130:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750100480:0@lo:400:kworker.0 00010000:00080000:0.0:1787784592.010141:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f534c3c0 x1874627750100992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784592.010150:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750100992:0@lo:400:kworker.0 00000100:00100000:3.0:1787784592.010259:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750099968 00000100:00100000:3.0:1787784592.010264:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750099968 00000100:00100000:3.0:1787784592.010328:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787784592.010336:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3647:x1874627750099968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784592.010391:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3647:x1874627750099968:12345-0@lo:400:kworker.0 Request processed in 54us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784592.010399:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787784592.010488:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750099968:0@lo:400:kworker.0 00010000:00010000:2.0:1787784592.901934:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784593.547962:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750101632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784593.548033:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784593.548128:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750101632 00000100:00100000:0.0:1787784593.548137:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750101632 00000100:00100000:0.0:1787784593.548189:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787784593.548199:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750101632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784593.548244:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784593.548297:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750101632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784593.548305:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787784593.548348:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750101632:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1787784593.647472:0:12898:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787784593.650754:0:12898:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787784593.926100:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784594.955389:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784595.745416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784595.745449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784595.745471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784595.745489:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784595.745510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784595.745535:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728001024 00000100:00100000:3.0:1787784595.745543:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728001024 00000100:00100000:3.0:1787784595.745591:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728001280 00000100:00100000:3.0:1787784595.745595:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728001280 00000100:00100000:3.0:1787784595.745607:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728000896 00000100:00100000:3.0:1787784595.745609:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728000896 00000100:00100000:3.0:1787784595.745619:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728001152 00000100:00100000:3.0:1787784595.745622:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728001152 00000100:00100000:3.0:1787784595.745635:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:3.0:1787784595.745644:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728001024:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784595.745730:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728001024:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 85us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784595.745738:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:3.0:1787784595.745754:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00100000:3.0:1787784595.745760:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728001280:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784595.745807:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728001280:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 47us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784595.745815:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00100000:3.0:1787784595.745826:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:3.0:1787784595.745832:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627728000896:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784595.745852:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627728000896:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 20us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784595.745859:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:3.0:1787784595.745868:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 195 00000100:00100000:3.0:1787784595.745875:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728001152:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784595.745894:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728001152:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 20us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784595.745901:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 195 00000100:00100000:0.0:1787784595.746273:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728000768 00000100:00100000:0.0:1787784595.746277:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728000768 00000100:00100000:0.0:1787784595.746313:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 315 00000100:00100000:0.0:1787784595.746321:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728000768:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784595.746361:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728000768:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 41us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784595.746368:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 315 00000100:00080000:0.0:1787784595.746405:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784595.746410:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787784595.973974:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784596.618392:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750101760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784596.618471:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784596.618549:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784596.618560:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750101888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784596.618582:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784596.618612:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784596.618633:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750102016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784596.618659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784596.618688:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750101760 00000100:00100000:0.0:1787784596.618696:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750101760 00000100:00100000:0.0:1787784596.618790:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750101888 00000100:00100000:0.0:1787784596.618794:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750101888 00000100:00100000:0.0:1787784596.618816:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787784596.618826:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750101760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784596.618859:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784596.618907:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750101760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784596.618915:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787784596.618930:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787784596.618936:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750101888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784596.618945:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784596.618970:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750101888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784596.618976:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787784596.618996:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750102016 00000100:00100000:0.0:1787784596.619000:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750102016 00000100:00100000:0.0:1787784596.619023:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787784596.619046:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750102016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784596.619082:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787784596.619119:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750102016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784596.619125:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1787784596.619142:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784596.619181:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750102016:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1787784596.619211:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff488000 x1874627750101888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784596.619226:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750101888:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787784596.619237:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48b0c0 x1874627750101760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784596.619247:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750101760:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1787784596.624240:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1e5cc6ee-e7bb-4eda-bff3-48f824501258 00000020:00000080:1.0:1787784596.624249:0:8431:0:(genops.c:885:class_export_put()) final put ffff8950c26ec800/1e5cc6ee-e7bb-4eda-bff3-48f824501258 00000001:00100000:2.0:1787784596.625831:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1e5cc6ee-e7bb-4eda-bff3-48f824501258 00000020:00000080:2.0:1787784596.625848:0:9516:0:(genops.c:885:class_export_put()) final put ffff8950c259b000/1e5cc6ee-e7bb-4eda-bff3-48f824501258 00000020:00000080:3.0:1787784596.626453:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c26ec800/1e5cc6ee-e7bb-4eda-bff3-48f824501258 for lustre-OST0000 00000020:00000080:3.0:1787784596.626546:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c26ea000 for lustre-OST0000 00000020:00000080:1.0:1787784596.627220:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c259b000/1e5cc6ee-e7bb-4eda-bff3-48f824501258 for lustre-OST0001 00000020:00000080:1.0:1787784596.627338:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c2599800 for lustre-OST0001 00010000:00010000:0.0:1787784596.999002:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784597.125979:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750102272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784597.125980:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750102144:0@lo:400:kworker.0 00000100:00100000:2.0:1787784597.126097:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff457840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750102528:0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.126267:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784597.126337:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750102784:0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.126364:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784597.126380:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750103296:0@lo:400:kworker.0 00000100:00100000:3.0:1787784597.126386:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750102784 00000100:00100000:3.0:1787784597.126392:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750102784 00000100:00100000:0.0:1787784597.126402:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784597.126417:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750103808:0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.126435:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784597.126436:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787784597.126445:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750102784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.126451:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787784597.126455:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750102400:0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.126481:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784597.126496:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750102912:0@lo:400:kworker.0 00000100:00100000:3.0:1787784597.126502:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750102784:12345-0@lo:400:kworker.0 Request processed in 59us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784597.126509:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787784597.126515:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784597.126524:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750102400 00000100:00100000:3.0:1787784597.126526:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750102400 00000100:00100000:0.0:1787784597.126528:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750103424:0@lo:400:kworker.0 00000100:00100000:3.0:1787784597.126546:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787784597.126547:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784597.126552:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750102400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.126561:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750103936:0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.126578:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784597.126579:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750102400:12345-0@lo:400:kworker.0 Request processed in 27us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784597.126584:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787784597.126609:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750102784:0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.126721:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750102400:0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.126749:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750102272 00000100:00100000:0.0:1787784597.126753:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750102272 00000100:00100000:0.0:1787784597.126819:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787784597.126826:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750102272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787784597.126849:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784597.126886:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750102272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784597.126892:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787784597.126911:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750103296 00000100:00100000:0.0:1787784597.126915:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750103296 00000100:00100000:0.0:1787784597.126942:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750103808 00000100:00100000:0.0:1787784597.126945:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750103808 00000100:00100000:0.0:1787784597.126954:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750103424 00000100:00100000:0.0:1787784597.126956:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750103424 00000100:00100000:0.0:1787784597.126964:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750103936 00000100:00100000:0.0:1787784597.126965:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750103936 00000100:00100000:0.0:1787784597.126977:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787784597.126982:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750103296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.127023:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750103296:12345-0@lo:400:kworker.0 Request processed in 40us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784597.127030:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787784597.127041:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787784597.127046:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750103808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.127088:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750103808:12345-0@lo:400:kworker.0 Request processed in 41us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784597.127094:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787784597.127105:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787784597.127110:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750103424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.127136:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750103424:12345-0@lo:400:kworker.0 Request processed in 26us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784597.127141:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787784597.127152:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787784597.127158:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750103936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.127184:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750103936:12345-0@lo:400:kworker.0 Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784597.127190:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787784597.127215:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750102912 00000100:00100000:0.0:1787784597.127218:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750102912 00000100:00100000:0.0:1787784597.127241:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787784597.127248:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750102912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.127282:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750102912:12345-0@lo:400:kworker.0 Request processed in 35us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784597.127288:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787784597.127337:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750102912:0@lo:400:kworker.0 00010000:00080000:0.0:1787784597.127351:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d9e103c0 x1874627750103424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784597.127361:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750103424:0@lo:400:kworker.0 00010000:00080000:0.0:1787784597.127371:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36fcb40 x1874627750103936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784597.127377:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750103936:0@lo:400:kworker.0 00010000:00080000:0.0:1787784597.127386:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d9e10000 x1874627750103296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784597.127394:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750103296:0@lo:400:kworker.0 00010000:00080000:0.0:1787784597.127403:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36fe940 x1874627750103808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784597.127411:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750103808:0@lo:400:kworker.0 00010000:00080000:0.0:1787784597.127420:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36a4000 x1874627750102272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784597.127432:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750102272:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787784597.127988:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784597.130039:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784597.130109:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784597.130212:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750103040:0@lo:400:kworker.0 00000100:00100000:1.0:1787784597.130238:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750102656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784597.130245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784597.130262:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784597.130265:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750103552:0@lo:400:kworker.0 00000100:00100000:1.0:1787784597.130280:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750103168:0@lo:400:kworker.0 00000100:00100000:2.0:1787784597.130284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784597.130298:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784597.130312:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750103680:0@lo:400:kworker.0 00000100:00100000:1.0:1787784597.130332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784597.130371:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750102656 00000100:00100000:1.0:1787784597.130378:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750102656 00000100:00100000:1.0:1787784597.130421:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787784597.130430:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750102656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784597.130453:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784597.130494:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750102656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784597.130502:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1787784597.130535:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c32730c0 x1874627750102656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784597.130555:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750102656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784597.130590:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750103040 00000100:00100000:1.0:1787784597.130593:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750103040 00000100:00100000:1.0:1787784597.130636:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750103552 00000100:00100000:1.0:1787784597.130640:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750103552 00000100:00100000:1.0:1787784597.130653:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750103168 00000100:00100000:1.0:1787784597.130656:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750103168 00000100:00100000:1.0:1787784597.130666:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750103680 00000100:00100000:1.0:1787784597.130668:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750103680 00000100:00100000:1.0:1787784597.130680:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787784597.130686:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750103040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784597.130721:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750103040:12345-0@lo:400:kworker.0 Request processed in 35us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784597.130728:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787784597.130738:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787784597.130744:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3273c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750103552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784597.130787:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3273c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750103552:12345-0@lo:400:kworker.0 Request processed in 24us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784597.130794:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787784597.130804:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787784597.130811:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750103168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784597.130937:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750102144 00000100:00100000:3.0:1787784597.130942:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750102144 00000100:00100000:3.0:1787784597.130972:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787784597.130979:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3647:x1874627750102144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784597.131040:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787784597.131049:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750103680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784597.131217:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750103168:12345-0@lo:400:kworker.0 Request processed in 405us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784597.131225:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00010000:00080000:1.0:1787784597.131255:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d9e13c00 x1874627750103168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784597.131266:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750103168:0@lo:400:kworker.0 00000100:00100000:1.0:1787784597.131290:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750103040:0@lo:400:kworker.0 00000100:00100000:1.0:1787784597.131300:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750103552:0@lo:400:kworker.0 00000100:00100000:3.0:1787784597.132601:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3647:x1874627750102144:12345-0@lo:400:kworker.0 Request processed in 1615us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784597.132612:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00080000:3.0:1787784597.132660:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784597.132666:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784597.135043:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750102528 00000100:00100000:0.0:1787784597.135068:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750102528 00000100:00100000:0.0:1787784597.135141:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787784597.135151:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750102528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.135250:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750102528:12345-0@lo:400:kworker.0 Request processed in 100us (5141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784597.135257:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787784597.136406:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750102144:0@lo:400:kworker.0 00000100:00100000:0.0:1787784597.136406:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff457840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750102528:0@lo:400:kworker.0 00000100:00100000:1.0:1787784597.136472:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750103680:12345-0@lo:400:kworker.0 Request processed in 5424us (6138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784597.136482:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00010000:00080000:1.0:1787784597.136519:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d9e13480 x1874627750103680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784597.136530:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750103680:0@lo:400:kworker.0 00000001:02000400:3.0:1787784597.867407:0:13042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787784598.023346:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784598.662815:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750104064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784598.662936:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784598.663261:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750104064 00000100:00100000:0.0:1787784598.663271:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750104064 00000100:00100000:0.0:1787784598.663341:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787784598.663352:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750104064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784598.663413:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784598.663479:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750104064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784598.663487:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787784598.663538:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750104064:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787784599.054539:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784600.070009:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784600.863431:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784600.864110:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784600.864137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784600.864154:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784600.864180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784600.864327:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728001664 00000100:00100000:3.0:1787784600.864341:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728001664 00000100:00100000:3.0:1787784600.864407:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728001920 00000100:00100000:3.0:1787784600.864410:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728001920 00000100:00100000:3.0:1787784600.864421:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728001536 00000100:00100000:3.0:1787784600.864423:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728001536 00000100:00100000:3.0:1787784600.864434:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728001792 00000100:00100000:3.0:1787784600.864435:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728001792 00000100:00100000:3.0:1787784600.864451:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00100000:3.0:1787784600.864461:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728001664:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784600.864623:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728001664:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 162us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784600.864631:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00100000:3.0:1787784600.864649:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 203 00000100:00100000:3.0:1787784600.864655:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728001920:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784600.864679:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728001920:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784600.864684:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 203 00000100:00100000:3.0:1787784600.864693:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 204 00000100:00100000:3.0:1787784600.864697:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2407:x1874627728001536:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784600.864717:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2407:x1874627728001536:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 19us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784600.864722:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 204 00000100:00100000:3.0:1787784600.864730:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 205 00000100:00100000:3.0:1787784600.864736:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728001792:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784600.864753:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728001792:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 18us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784600.864789:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 205 00000100:00080000:3.0:1787784600.864811:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784600.864816:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784600.866785:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728001408 00000100:00100000:0.0:1787784600.866805:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728001408 00000100:00100000:0.0:1787784600.866888:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 317 00000100:00100000:0.0:1787784600.866904:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2407:x1874627728001408:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784600.867006:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2407:x1874627728001408:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 105us (3591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784600.867015:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 317 00010000:00010000:3.0:1787784601.093980:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784601.734380:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750104192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784601.734482:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784601.734582:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750104192 00000100:00100000:0.0:1787784601.734591:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750104192 00000100:00100000:0.0:1787784601.734654:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787784601.734665:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750104192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784601.734715:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787784601.734799:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750104192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784601.734821:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787784601.734894:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750104192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784601.735651:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750104320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784601.735704:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784601.735796:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750104320 00000100:00100000:0.0:1787784601.735803:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750104320 00000100:00100000:0.0:1787784601.735962:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787784601.735974:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750104320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784601.736004:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784601.736195:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750104320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 223us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784601.736204:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1787784601.736226:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784601.736253:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750104448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784601.736285:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784601.736326:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750104448 00000100:00100000:0.0:1787784601.736331:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750104448 00000100:00100000:0.0:1787784601.736358:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787784601.736365:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750104448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784601.736381:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784601.736413:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750104448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784601.736419:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1787784601.736432:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787784601.736455:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36fde00 x1874627750104448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784601.736486:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750104448:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787784601.747437:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3272940 x1874627750104320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784601.747479:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750104320:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1787784601.900754:0:13191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca6aaeed0 20000000:00000080:1.0:1787784601.900896:0:13191:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8950c34ad800 uarg=0000000000000000 20000000:01000000:1.0:1787784601.900956:0:13191:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787784601.900963:0:13191:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787784601.900969:0:13191:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787784601.901535:0:13192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787784601.901949:0:13191:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787784601.910080:0:13191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787784601.910126:0:13191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.910154:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951df603c00/0x88ace7295d9cde8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728da expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.910164:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951d1628800/0x88ace7295d9cdf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cdef expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.910172:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff895201c5be00/0x88ace7295d9ce04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cdfd expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.910179:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff895201c5ba00/0x88ace7295d9ce12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ce0b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.910730:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951df602a00/0x88ace7295d9ce20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ce19 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.910739:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff895201c5ac00/0x88ace7295d9ce35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72919 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.910748:0:13191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.911038:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff895201c5ac00/0x88ace7295d9ce35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72919 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.911058:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff895201c5ac00/0x88ace7295d9ce35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72919 expref: 12 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784601.911076:0:13191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52903c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874627750104576:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784601.911609:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951df602a00/0x88ace7295d9ce20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ce19 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.911621:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951df602a00/0x88ace7295d9ce20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ce19 expref: 23 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784601.911632:0:13191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874627750104704:0@lo:104: 00000100:00100000:1.0:1787784601.911700:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784601.911755:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff895201c5ba00/0x88ace7295d9ce12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ce0b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.911764:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff895201c5ba00/0x88ace7295d9ce12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ce0b expref: 23 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784601.911816:0:13191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2666940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874627750104832:0@lo:104: 00000100:00100000:1.0:1787784601.911845:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784601.915027:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784601.915086:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728002048 00000100:00100000:3.0:1787784601.915096:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728002048 00010000:00010000:3.0:1787784601.915149:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff895201c5ac00/0x88ace7295d9ce35 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72919 expref: 13 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784601.915199:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:3.0:1787784601.915209:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2405:x1874627728002048:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784601.915229:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784601.915236:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff895201c5ac00/0x88ace7295d9ce35 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72919 expref: 13 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.915251:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff895201c5ac00/0x88ace7295d9ce35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72919 expref: 13 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.915287:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784601.915347:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2405:x1874627728002048:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 139us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784601.915355:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:0.0:1787784601.916416:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750104704 00000100:00100000:0.0:1787784601.916429:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750104704 00000100:00100000:0.0:1787784601.916486:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750104832 00000100:00100000:0.0:1787784601.916490:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750104832 00000100:00100000:0.0:1787784601.916507:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784601.916516:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:13191:x1874627750104704:12345-0@lo:104: 00010000:00010000:0.0:1787784601.916536:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784601.916630:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784601.916637:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:13191:x1874627750104704:12345-0@lo:104: Request processed in 123us (4938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784601.916644:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784601.916660:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787784601.916675:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2667c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:13191:x1874627750104832:12345-0@lo:104: 00010000:00010000:0.0:1787784601.916684:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce12 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784601.916726:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787784601.916731:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2667c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:13191:x1874627750104832:12345-0@lo:104: Request processed in 66us (4886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784601.916736:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1787784601.916753:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784601.916761:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784601.916818:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5a800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784601.916824:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ce20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784601.916833:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ce20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784601.916841:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ce20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784601.916848:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784601.917031:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784601.917038:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784601.917062:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784601.917068:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff895201c5a800/0x88ace7295d9ce19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784601.917084:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784601.917087:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce12 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784601.917092:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784601.917095:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ce12 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784601.917114:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ce12 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784601.917119:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ce12 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784601.917124:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784601.917139:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce12 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784601.917145:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784601.917150:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce12 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784601.917156:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff895201c5b400/0x88ace7295d9ce0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce12 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784601.917166:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784601.917167:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784601.917169:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784601.917420:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750104960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784601.917477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784601.917586:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784601.917688:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff895201c5be00/0x88ace7295d9ce04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cdfd expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.917702:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff895201c5be00/0x88ace7295d9ce04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cdfd expref: 23 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784601.917713:0:13191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874627750105216:0@lo:104: 00000100:00100000:1.0:1787784601.917745:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784601.917800:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951d1628800/0x88ace7295d9cdf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cdef expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.917809:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951d1628800/0x88ace7295d9cdf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cdef expref: 23 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784601.917817:0:13191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26643c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874627750105344:0@lo:104: 00000100:00100000:1.0:1787784601.917839:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784601.917862:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951df603c00/0x88ace7295d9cde8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728da expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.917873:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951df603c00/0x88ace7295d9cde8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728da expref: 12 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784601.917894:0:13191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874627750105472:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784601.917956:0:13191:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5180 going to sleep for 11 seconds 00010000:00010000:1.0:1787784601.917985:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5ac00/0x88ace7295d9ce35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72919 expref: 12 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784601.918026:0:13191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52903c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874627750104576:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784601.918042:0:13191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874627750104704:0@lo:104: 00000100:00100000:1.0:1787784601.918051:0:13191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2666940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874627750104832:0@lo:104: 00000100:00100000:1.0:1787784601.920381:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750105088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784601.920473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784601.920564:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750105216 00000100:00100000:1.0:1787784601.920574:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750105216 00000100:00100000:1.0:1787784601.920619:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750105344 00000100:00100000:1.0:1787784601.920622:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750105344 00000100:00100000:1.0:1787784601.920637:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784601.920646:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2664780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:13191:x1874627750105216:12345-0@lo:104: 00010000:00010000:1.0:1787784601.920678:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce04 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.920751:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787784601.920757:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2664780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+4:13191:x1874627750105216:12345-0@lo:104: Request processed in 112us (3011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784601.920765:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784601.920802:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787784601.920808:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2665680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:13191:x1874627750105344:12345-0@lo:104: 00010000:00010000:1.0:1787784601.920816:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cdf6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.920852:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787784601.920857:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2665680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee96db03-39cf-4d18-a974-880a628ded6e+3:13191:x1874627750105344:12345-0@lo:104: Request processed in 50us (3018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784601.920879:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787784601.920939:0:13191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874627750105216:0@lo:104: 00000100:00100000:1.0:1787784601.920950:0:13191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26643c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874627750105344:0@lo:104: 00000100:00100000:3.0:1787784601.921475:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750104960 00000100:00100000:3.0:1787784601.921482:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750104960 00010000:00010000:3.0:1787784601.921516:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951df602a00/0x88ace7295d9ce20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ce19 expref: 24 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784601.921691:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750105088 00000100:00100000:3.0:1787784601.921695:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750105088 00010000:00010000:3.0:1787784601.921710:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff895201c5ba00/0x88ace7295d9ce12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ce0b expref: 25 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784601.921734:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787784601.921741:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+25:3646:x1874627750104960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784601.921754:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784601.921759:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951df602a00/0x88ace7295d9ce20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ce19 expref: 25 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.921807:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951df602a00/0x88ace7295d9ce20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ce19 expref: 25 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.921831:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df602a00/0x88ace7295d9ce20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ce19 expref: 25 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.921853:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784601.921917:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750104960:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (4440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784601.921924:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787784601.921939:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787784601.921945:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+23:3647:x1874627750105088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784601.921955:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784601.921959:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff895201c5ba00/0x88ace7295d9ce12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ce0b expref: 23 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.921967:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff895201c5ba00/0x88ace7295d9ce12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ce0b expref: 23 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.921985:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5ba00/0x88ace7295d9ce12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ce0b expref: 23 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.921995:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784601.922039:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee96db03-39cf-4d18-a974-880a628ded6e+22:3647:x1874627750105088:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784601.922046:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1787784601.922066:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784601.922074:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce04 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.922082:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784601.922087:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ce04 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.922097:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ce04 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784601.922104:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ce04 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784601.922112:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787784601.922152:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce04 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.922160:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784601.922194:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce04 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.922202:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951df603000/0x88ace7295d9cdfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce04 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.922222:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784601.922226:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cdf6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.922232:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784601.922235:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cdf6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.922242:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cdf6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784601.922247:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cdf6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784601.922252:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787784601.922279:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cdf6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.922285:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784601.922292:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cdf6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.922298:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9cdef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cdf6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784601.922311:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784601.922313:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784601.922315:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784601.922378:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750105088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784601.923572:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750105600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784601.923633:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784601.923703:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784601.923711:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750105728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784601.923735:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784601.923808:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750105600 00000100:00100000:2.0:1787784601.923816:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750105600 00010000:00010000:2.0:1787784601.923852:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff895201c5be00/0x88ace7295d9ce04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cdfd expref: 22 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784601.923877:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750105728 00000100:00100000:2.0:1787784601.923880:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750105728 00010000:00010000:2.0:1787784601.923904:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951d1628800/0x88ace7295d9cdf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cdef expref: 23 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784601.923919:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787784601.923928:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+23:3644:x1874627750105600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784601.923942:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784601.923947:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff895201c5be00/0x88ace7295d9ce04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cdfd expref: 23 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784601.923958:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff895201c5be00/0x88ace7295d9ce04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cdfd expref: 23 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784601.923975:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5be00/0x88ace7295d9ce04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cdfd expref: 23 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784601.923990:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784601.924038:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+22:3644:x1874627750105600:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784601.924046:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787784601.924063:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787784601.924069:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+21:3644:x1874627750105728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784601.924078:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784601.924082:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951d1628800/0x88ace7295d9cdf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cdef expref: 21 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784601.924101:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951d1628800/0x88ace7295d9cdf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cdef expref: 21 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784601.924111:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1628800/0x88ace7295d9cdf6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cdef expref: 21 pid: 6516 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784601.924121:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784601.924144:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+20:3644:x1874627750105728:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784601.924151:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787784601.924186:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750105728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784601.924194:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750105600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784601.925657:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784601.926032:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750104960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784601.926219:0:13191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874627750105472:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784601.926264:0:13191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784601.926437:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728002176 00000100:00100000:1.0:1787784601.926448:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728002176 00010000:00010000:1.0:1787784601.926492:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951df603c00/0x88ace7295d9cde8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728da expref: 12 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784601.926567:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:1.0:1787784601.926578:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfebe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+12:2406:x1874627728002176:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784601.926598:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784601.926605:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951df603c00/0x88ace7295d9cde8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728da expref: 12 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.926618:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951df603c00/0x88ace7295d9cde8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728da expref: 12 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.926639:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df603c00/0x88ace7295d9cde8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728da expref: 12 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.926659:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.926679:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.926698:0:8452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.926722:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.926730:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.926737:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.926745:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784601.926749:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.926759:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.926804:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784601.926815:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784601.927049:0:13191:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784601.927057:0:13191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784601.927064:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df602000/0x88ace7295d9ce58 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784601.928276:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfebe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+11:2406:x1874627728002176:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 306us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784601.928293:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 45 00010000:00010000:0.0:1787784601.929391:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784602.139398:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784602.246128:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784602.246155:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750105856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784602.246240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784602.246459:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750106368:0@lo:400:kworker.0 00000100:00100000:2.0:1787784602.246476:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750106112:0@lo:400:kworker.0 00000100:00100000:0.0:1787784602.246500:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784602.246565:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750105856 00000100:00100000:1.0:1787784602.246573:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750105856 00000100:00100000:1.0:1787784602.246638:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787784602.246649:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750105856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784602.246680:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784602.246713:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750106240:0@lo:400:kworker.0 00000100:00100000:3.0:1787784602.246760:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750105984:0@lo:400:kworker.0 00000100:00100000:0.0:1787784602.254426:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1218b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750106880:0@lo:400:kworker.0 00000100:00100000:1.0:1787784602.254448:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750105856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7798us (8204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784602.254471:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787784602.254507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787784602.254515:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784602.254569:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750106368 00000100:00100000:1.0:1787784602.254577:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750106368 00000100:00100000:0.0:1787784602.254585:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750106880 00000100:00100000:0.0:1787784602.254590:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750106880 00000100:00100000:0.0:1787784602.254621:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787784602.254630:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750106880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784602.254635:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787784602.254646:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750106368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784602.254679:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750106880:12345-0@lo:400:kworker.0 Request processed in 50us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784602.254688:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787784602.254699:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750106368:12345-0@lo:400:kworker.0 Request processed in 55us (8199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784602.254707:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787784602.254712:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750107392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784602.254738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784602.254790:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750106368:0@lo:400:kworker.0 00010000:00080000:0.0:1787784602.254804:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c1218b40 x1874627750106880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784602.254815:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1218b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750106880:0@lo:400:kworker.0 00000100:00100000:0.0:1787784602.254842:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750107392 00000100:00100000:0.0:1787784602.254846:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750107392 00000100:00100000:0.0:1787784602.254880:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1787784602.254884:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784602.254890:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750107392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787784602.254908:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784602.254957:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750107392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784602.254964:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1787784602.255514:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d9e12580 x1874627750107392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784602.255529:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750107392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784602.255852:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784602.255879:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750106752:0@lo:400:kworker.0 00000100:00100000:2.0:1787784602.255919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784602.255953:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750107264:0@lo:400:kworker.0 00000100:00100000:2.0:1787784602.255977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784602.255983:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750106240 00000100:00100000:0.0:1787784602.255990:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750106240 00000100:00100000:2.0:1787784602.256026:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750106752 00000100:00100000:2.0:1787784602.256030:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750106752 00000100:00100000:0.0:1787784602.256056:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787784602.256062:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750107264 00000100:00100000:2.0:1787784602.256066:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750107264 00000100:00100000:0.0:1787784602.256068:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750106240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784602.256088:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787784602.256096:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1219a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750106752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784602.256146:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750106240:12345-0@lo:400:kworker.0 Request processed in 81us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784602.256153:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787784602.256160:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1219a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750106752:12345-0@lo:400:kworker.0 Request processed in 63us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784602.256168:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787784602.256185:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787784602.256191:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1218780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750107264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784602.256220:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1218780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750107264:12345-0@lo:400:kworker.0 Request processed in 29us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784602.256227:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787784602.256249:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784602.256280:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750106624:0@lo:400:kworker.0 00000100:00100000:2.0:1787784602.256303:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784602.256321:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1219e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750107136:0@lo:400:kworker.0 00000100:00100000:2.0:1787784602.256340:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784602.256367:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750106624 00000100:00100000:2.0:1787784602.256371:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750106624 00000100:00100000:2.0:1787784602.256415:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750107136 00000100:00100000:2.0:1787784602.256419:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750107136 00000100:00100000:2.0:1787784602.256441:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787784602.256453:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750106624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784602.256488:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750106112 00000100:00100000:2.0:1787784602.256494:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750106624:12345-0@lo:400:kworker.0 Request processed in 39us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784602.256494:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750106112 00000100:00100000:2.0:1787784602.256503:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787784602.256521:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787784602.256526:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787784602.256536:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750106112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784602.256543:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750107136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784602.256580:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750106112:12345-0@lo:400:kworker.0 Request processed in 47us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784602.256592:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750107136:12345-0@lo:400:kworker.0 Request processed in 62us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784602.256592:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787784602.256602:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787784602.256649:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750106112:0@lo:400:kworker.0 00010000:00080000:2.0:1787784602.256659:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c121a940 x1874627750106624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784602.256667:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750106624:0@lo:400:kworker.0 00010000:00080000:2.0:1787784602.256675:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c1219e00 x1874627750107136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784602.256682:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1219e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750107136:0@lo:400:kworker.0 00000100:00100000:2.0:1787784602.256714:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750106240:0@lo:400:kworker.0 00010000:00080000:2.0:1787784602.256723:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c121bc00 x1874627750106752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784602.256730:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750106752:0@lo:400:kworker.0 00010000:00080000:2.0:1787784602.256738:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c1218000 x1874627750107264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784602.256745:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750107264:0@lo:400:kworker.0 00000100:00080000:1.0:1787784602.257553:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784602.260332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784602.260387:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1219680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750106496:0@lo:400:kworker.0 00000100:00100000:3.0:1787784602.260426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784602.260499:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750107008:0@lo:400:kworker.0 00000100:00100000:3.0:1787784602.260522:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787784602.261279:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c32730c0 x1874627750105856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784602.261301:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750105856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784602.261494:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750105984 00000100:00100000:2.0:1787784602.261501:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750105984 00000100:00100000:2.0:1787784602.261657:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750106496 00000100:00100000:2.0:1787784602.261661:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750106496 00000100:00100000:3.0:1787784602.261824:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750107008 00000100:00100000:3.0:1787784602.261828:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750107008 00000100:00100000:3.0:1787784602.261862:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787784602.261871:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750105984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784602.261935:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750105984:12345-0@lo:400:kworker.0 Request processed in 65us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784602.261942:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787784602.261959:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787784602.261982:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750106496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784602.262181:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787784602.262192:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750107008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784602.262232:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750107008:12345-0@lo:400:kworker.0 Request processed in 43us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784602.262237:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:0.0:1787784602.262267:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784602.264974:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750106496:12345-0@lo:400:kworker.0 Request processed in 2982us (4536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784602.264992:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787784602.265082:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750105984:0@lo:400:kworker.0 00000100:00100000:3.0:1787784602.265095:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1219680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750106496:0@lo:400:kworker.0 00000100:00100000:3.0:1787784602.265106:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750107008:0@lo:400:kworker.0 00000100:00100000:3.0:1787784602.973414:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784602.973455:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728002304 00000100:00100000:3.0:1787784602.973464:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728002304 00000100:00100000:3.0:1787784602.973521:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 318 00000100:00100000:3.0:1787784602.973532:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+11:6181:x1874627728002304:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784602.973547:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784602.973566:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d35c00/0x88ace7295d9ce5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7294a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784602.973594:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d35c00/0x88ace7295d9ce5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7294a expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784602.973605:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d35c00/0x88ace7295d9ce5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7294a expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784602.973613:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35c00, rc 0) 00000100:00100000:3.0:1787784602.973667:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728002304:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 138us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784602.973674:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 318 00000100:00100000:1.0:1787784602.978241:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784602.978282:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728002432 00000100:00100000:1.0:1787784602.978292:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728002432 00000100:00100000:1.0:1787784602.978344:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 319 00000100:00100000:1.0:1787784602.978354:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728002432:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784602.978500:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728002432:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 146us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784602.978508:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 319 00000100:00100000:3.0:1787784602.982546:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784602.983483:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728002560 00000100:00100000:1.0:1787784602.983497:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728002560 00000100:00100000:1.0:1787784602.983557:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 320 00000100:00100000:1.0:1787784602.983568:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfeea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728002560:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784602.983712:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfeea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728002560:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 145us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784602.983720:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 320 00000100:00100000:0.0:1787784602.993737:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784602.993985:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728002688 00000100:00100000:3.0:1787784602.993996:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728002688 00000100:00100000:3.0:1787784602.994092:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 321 00000100:00100000:3.0:1787784602.994104:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfeeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728002688:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784602.994122:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784602.994142:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34c00/0x88ace7295d9ce66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72951 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784602.994170:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34c00/0x88ace7295d9ce66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72951 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784602.994181:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34c00/0x88ace7295d9ce66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72951 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784602.994201:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34c00, rc 0) 00000100:00100000:3.0:1787784602.994264:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfeeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728002688:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 162us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784602.994272:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 321 00000100:00100000:1.0:1787784603.006614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784603.011302:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728002816 00000100:00100000:2.0:1787784603.011319:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728002816 00000100:00100000:2.0:1787784603.011389:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 322 00000100:00100000:2.0:1787784603.011399:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728002816:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784603.011554:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728002816:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 155us (4946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784603.011561:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 322 00000100:00100000:0.0:1787784603.019809:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784603.019852:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728002944 00000100:00100000:0.0:1787784603.019861:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728002944 00000100:00100000:0.0:1787784603.019909:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 323 00000100:00100000:0.0:1787784603.019918:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728002944:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784603.020067:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728002944:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 149us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784603.020075:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 323 00010000:00010000:3.0:1787784603.141939:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787784603.398337:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787784603.398346:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951f53b5800 from 7 10000000:01000000:2.0:1787784603.398352:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784603.398401:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784603.398414:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784603.398425:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784603.398453:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750107520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784603.398526:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784603.398654:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df6653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784603.400117:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750107520 00000100:00100000:3.0:1787784603.400130:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750107520 00000100:00100000:3.0:1787784603.400245:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787784603.400255:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750107520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784603.400270:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784603.400286:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d35a00/0x88ace7295d9ce74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ce6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784603.400312:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d35a00/0x88ace7295d9ce74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ce6d expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784603.400330:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d35a00/0x88ace7295d9ce74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ce6d expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784603.400340:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35a00, rc 0) 00000100:00100000:3.0:1787784603.400415:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750107520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784603.400422:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787784603.400517:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750107520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784603.400538:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784603.400555:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ce74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784603.400621:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750107648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784603.400654:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784603.403434:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750107648 00000100:00100000:1.0:1787784603.403448:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750107648 00000100:00100000:1.0:1787784603.403529:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787784603.403541:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750107648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784603.403731:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750107648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784603.403739:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787784603.404302:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df6653c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784603.404323:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750107648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784603.404366:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750107776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784603.404417:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784603.404440:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df6653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784603.405061:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750107776 00000100:00100000:1.0:1787784603.405067:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750107776 00000100:00100000:1.0:1787784603.405108:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787784603.405116:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750107776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784603.405239:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750107776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784603.405247:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787784603.405414:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750107776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787784603.416697:0:13247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787784603.417493:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787784603.417519:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784603.417531:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784603.417544:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784603.417555:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784603.417558:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951efedf000 from 7 10000000:01000000:3.0:1787784603.417560:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784603.417600:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784603.417608:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784603.417630:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784603.417752:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26643c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750107904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784603.417851:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784603.417912:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784603.419754:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750107904 00000100:00100000:1.0:1787784603.419785:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750107904 00000100:00100000:1.0:1787784603.419848:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787784603.419858:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750107904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784603.419874:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784603.419891:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df603800/0x88ace7295d9ce82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ce7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784603.419930:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603800/0x88ace7295d9ce82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ce7b expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784603.419942:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df603800/0x88ace7295d9ce82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ce7b expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784603.419951:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603800, rc 0) 00000100:00100000:1.0:1787784603.420025:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750107904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784603.420032:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787784603.420273:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26643c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750107904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784603.420291:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784603.420300:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ce82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784603.420382:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26643c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784603.420418:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784603.420451:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784603.420498:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750108032 00000100:00100000:1.0:1787784603.420503:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750108032 00000100:00100000:1.0:1787784603.420532:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787784603.420539:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750108032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784603.420918:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750108032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 379us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784603.420926:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787784603.425807:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26643c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784603.430127:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784603.430221:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784603.430271:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665600 going to sleep for 11 seconds 00000100:00100000:3.0:1787784603.430423:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750108160 00000100:00100000:3.0:1787784603.430431:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750108160 00000100:00100000:3.0:1787784603.430498:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1787784603.430509:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750108160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784603.430648:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750108160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784603.430670:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787784603.430948:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787784603.432860:0:13248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787784603.433753:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787784603.433804:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784603.433816:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784603.433828:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784603.433839:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784603.433851:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951cfe95800 from 7 10000000:01000000:3.0:1787784603.433855:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784603.433905:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784603.433913:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784603.433924:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784603.433950:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784603.434029:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784603.434150:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784603.434283:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750108288 00000100:00100000:2.0:1787784603.434292:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750108288 00000100:00100000:2.0:1787784603.434338:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787784603.434347:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750108288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784603.434362:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784603.434374:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff895201c5a000/0x88ace7295d9ce90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ce89 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784603.434410:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff895201c5a000/0x88ace7295d9ce90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ce89 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784603.434421:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff895201c5a000/0x88ace7295d9ce90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ce89 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784603.434430:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a000, rc 0) 00000100:00100000:2.0:1787784603.434469:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750108288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784603.434476:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787784603.435920:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784603.435939:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784603.435948:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ce90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784603.436022:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784603.436072:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784603.436169:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784603.436274:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750108416 00000100:00100000:2.0:1787784603.436280:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750108416 00000100:00100000:2.0:1787784603.436322:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787784603.436331:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750108416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784603.436437:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750108416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784603.436445:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787784603.436522:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784603.436550:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784603.436584:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784603.436605:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784603.436660:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750108544 00000100:00100000:2.0:1787784603.436665:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750108544 00000100:00100000:2.0:1787784603.436690:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787784603.436697:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750108544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784603.436788:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750108544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784603.436795:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787784603.436925:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787784603.438582:0:13249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787784603.438904:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787784603.438930:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784603.438950:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784603.438962:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784603.438974:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787784603.438977:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951d08ed800 from 7 10000000:01000000:2.0:1787784603.438980:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784603.439024:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784603.439032:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784603.439042:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784603.439064:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784603.440254:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784603.440306:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784603.440625:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750108672 00000100:00100000:3.0:1787784603.440633:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750108672 00000100:00100000:3.0:1787784603.440853:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787784603.440864:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750108672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784603.440879:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784603.440895:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3713e00/0x88ace7295d9ce9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ce97 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784603.440948:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3713e00/0x88ace7295d9ce9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ce97 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784603.440971:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3713e00/0x88ace7295d9ce9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ce97 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784603.440980:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713e00, rc 0) 00000100:00100000:0.0:1787784603.441037:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750108672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784603.441045:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787784603.441899:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784603.441920:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784603.441929:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ce9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784603.442023:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784603.442064:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784603.442544:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784603.443894:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750108800 00000100:00100000:2.0:1787784603.443904:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750108800 00000100:00100000:2.0:1787784603.443963:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787784603.443973:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750108800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784603.444155:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750108800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784603.444164:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787784603.445231:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784603.445289:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784603.445351:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784603.445394:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784603.445453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750108928 00000100:00100000:2.0:1787784603.445459:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750108928 00000100:00100000:2.0:1787784603.445514:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787784603.445523:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750108928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784603.445627:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750108928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784603.445636:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787784603.445756:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750108928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787784603.446432:0:13250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787784603.446501:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787784603.446533:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787784603.446543:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784603.446554:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ce9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784603.782029:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784603.782055:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750109056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784603.782130:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784603.782255:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750109056 00000100:00100000:0.0:1787784603.782262:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750109056 00000100:00100000:0.0:1787784603.782323:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787784603.782333:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1219e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750109056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784603.782371:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784603.782419:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1219e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750109056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784603.782426:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787784603.782517:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750109056:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787784604.165867:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784605.191615:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787784605.613305:0:13389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787784605.984930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784605.984970:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784605.985018:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784605.985045:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784605.985072:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784605.985099:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728003200 00000100:00100000:2.0:1787784605.985119:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728003200 00000100:00100000:2.0:1787784605.985176:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728003456 00000100:00100000:2.0:1787784605.985179:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728003456 00000100:00100000:2.0:1787784605.985193:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728003328 00000100:00100000:2.0:1787784605.985195:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728003328 00000100:00100000:2.0:1787784605.985207:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728003584 00000100:00100000:2.0:1787784605.985209:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728003584 00000100:00100000:2.0:1787784605.985224:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 212 00000100:00100000:2.0:1787784605.985233:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728003200:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784605.985312:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728003200:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 79us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784605.985319:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 212 00000100:00100000:2.0:1787784605.985349:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 213 00000100:00100000:2.0:1787784605.985356:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728003456:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784605.985383:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728003456:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784605.985389:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 213 00000100:00100000:2.0:1787784605.985418:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 214 00000100:00100000:2.0:1787784605.985424:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728003328:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784605.985450:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728003328:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784605.985456:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 214 00000100:00100000:2.0:1787784605.985467:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 215 00000100:00100000:2.0:1787784605.985472:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1218f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728003584:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784605.985493:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1218f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728003584:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 20us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784605.985498:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 215 00000100:00080000:2.0:1787784605.985518:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784605.985522:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784605.985681:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728003072 00000100:00100000:0.0:1787784605.985686:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728003072 00000100:00100000:0.0:1787784605.985725:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 336 00000100:00100000:0.0:1787784605.985732:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2405:x1874627728003072:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784605.985763:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2405:x1874627728003072:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 32us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784605.985796:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 336 00010000:00010000:3.0:1787784606.214190:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784606.854324:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750109184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784606.854420:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784606.854558:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750109184 00000100:00100000:1.0:1787784606.854566:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750109184 00000100:00100000:1.0:1787784606.854649:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787784606.854666:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2666940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750109184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787784606.854697:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784606.854749:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2666940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750109184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784606.854756:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1787784606.854834:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d9e10000 x1874627750109184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784606.854851:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750109184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784606.855036:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750109312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784606.855070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784606.855345:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784606.855357:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750109440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784606.855386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784606.855793:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750109440 00000100:00100000:1.0:1787784606.855799:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750109440 00000100:00100000:1.0:1787784606.855842:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787784606.855851:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750109440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784606.855864:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784606.855907:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750109440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784606.855915:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1787784606.856026:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48f480 x1874627750109440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784606.856041:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750109440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784606.856114:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750109312 00000100:00100000:0.0:1787784606.856118:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750109312 00000100:00100000:0.0:1787784606.856154:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787784606.856161:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750109312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784606.856185:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787784606.856235:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750109312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784606.856242:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1787784606.856259:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784606.857137:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750109312:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787784607.238165:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784607.365887:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750109568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784607.365958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784607.366044:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750109568 00000100:00100000:3.0:1787784607.366052:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750109568 00000100:00100000:3.0:1787784607.366106:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787784607.366116:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750109568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784607.366147:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784607.366194:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750109568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784607.366201:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1787784607.366222:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787784607.366249:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2665e00 x1874627750109568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784607.366265:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750109568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784607.366487:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750109696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784607.366528:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784607.366564:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750109696 00000100:00100000:3.0:1787784607.366569:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750109696 00000100:00100000:3.0:1787784607.367525:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787784607.367534:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750109696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787784607.367553:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784607.367989:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750109696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784607.367997:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1787784607.368022:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787784607.368047:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2665e00 x1874627750109696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784607.368065:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750109696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784607.368555:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750109952:0@lo:400:kworker.0 00000100:00100000:0.0:1787784607.369159:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750109824:0@lo:400:kworker.0 00000100:00100000:0.0:1787784607.369221:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784607.369262:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750110336:0@lo:400:kworker.0 00000100:00100000:0.0:1787784607.369289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784607.369314:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787784607.369320:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750110208:0@lo:400:kworker.0 00000100:00100000:0.0:1787784607.369341:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784607.369359:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750110720:0@lo:400:kworker.0 00000100:00100000:0.0:1787784607.369489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784607.369526:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750109824 00000100:00100000:0.0:1787784607.369532:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750109824 00000100:00100000:0.0:1787784607.369588:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787784607.369610:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750109824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784607.369739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784607.369761:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750110464:0@lo:400:kworker.0 00000100:00100000:3.0:1787784607.369803:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784607.369822:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787784607.369829:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750110080:0@lo:400:kworker.0 00000100:00100000:3.0:1787784607.369854:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784607.369872:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750110592:0@lo:400:kworker.0 00000100:00100000:3.0:1787784607.369893:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784607.369913:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750110336 00000100:00100000:3.0:1787784607.369916:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750110336 00000100:00100000:3.0:1787784607.369945:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750110208 00000100:00100000:3.0:1787784607.369948:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750110208 00000100:00100000:3.0:1787784607.369984:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750110720 00000100:00100000:3.0:1787784607.369987:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750110720 00000100:00100000:3.0:1787784607.370001:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750109952 00000100:00100000:3.0:1787784607.370003:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750109952 00000100:00100000:3.0:1787784607.370012:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750110464 00000100:00100000:3.0:1787784607.370014:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750110464 00000100:00100000:3.0:1787784607.370025:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750110592 00000100:00100000:3.0:1787784607.370028:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750110592 00000100:00100000:3.0:1787784607.370040:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787784607.370046:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750110336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784607.370095:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750110336:12345-0@lo:400:kworker.0 Request processed in 49us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784607.370102:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787784607.370118:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787784607.370124:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750110208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784607.370154:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750110208:12345-0@lo:400:kworker.0 Request processed in 30us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784607.370160:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787784607.370172:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787784607.370178:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750110720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784607.370206:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750110720:12345-0@lo:400:kworker.0 Request processed in 28us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784607.370211:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787784607.370222:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787784607.370227:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750109952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784607.370257:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750109952:12345-0@lo:400:kworker.0 Request processed in 30us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784607.370272:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787784607.370285:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787784607.370290:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750110464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784607.370318:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750110464:12345-0@lo:400:kworker.0 Request processed in 28us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784607.370324:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787784607.370334:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787784607.370340:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750110592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784607.370366:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750110592:12345-0@lo:400:kworker.0 Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784607.370372:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787784607.370929:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750110080 00000100:00100000:1.0:1787784607.370935:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750110080 00000100:00100000:1.0:1787784607.370979:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787784607.370988:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750110080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784607.371030:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750110080:12345-0@lo:400:kworker.0 Request processed in 44us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784607.371036:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787784607.371085:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750110208:0@lo:400:kworker.0 00010000:00080000:1.0:1787784607.371099:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36d1e00 x1874627750110720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784607.371109:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750110720:0@lo:400:kworker.0 00000100:00100000:1.0:1787784607.371120:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750110336:0@lo:400:kworker.0 00000100:00100000:1.0:1787784607.372573:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750109824:12345-0@lo:400:kworker.0 Request processed in 2946us (3334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784607.372586:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787784607.374188:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750109824:0@lo:400:kworker.0 00000100:00080000:3.0:1787784607.374299:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784607.374304:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784607.374331:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750110080:0@lo:400:kworker.0 00000100:00100000:3.0:1787784607.374344:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750110592:0@lo:400:kworker.0 00000100:00100000:3.0:1787784607.374355:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750109952:0@lo:400:kworker.0 00010000:00080000:3.0:1787784607.374368:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36d30c0 x1874627750110464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784607.374686:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750110464:0@lo:400:kworker.0 00010000:00010000:3.0:1787784608.262883:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784608.902406:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750110848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784608.902489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784608.902612:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750110848 00000100:00100000:2.0:1787784608.902620:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750110848 00000100:00100000:2.0:1787784608.902679:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787784608.902689:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750110848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787784608.902729:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787784608.906751:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750110848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4049us (4247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784608.906815:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787784608.907932:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750110848:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787784609.287919:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784610.317381:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784611.114252:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784611.114286:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784611.114306:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784611.114326:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784611.114347:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784611.114374:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728003968 00000100:00100000:2.0:1787784611.114383:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728003968 00000100:00100000:2.0:1787784611.114440:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728004224 00000100:00100000:2.0:1787784611.114444:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728004224 00000100:00100000:2.0:1787784611.114457:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728003840 00000100:00100000:2.0:1787784611.114459:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728003840 00000100:00100000:2.0:1787784611.114471:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728004096 00000100:00100000:2.0:1787784611.114474:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728004096 00000100:00100000:2.0:1787784611.114489:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 222 00000100:00100000:2.0:1787784611.114496:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728003968:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784611.114558:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728003968:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 63us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784611.114564:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 222 00000100:00100000:2.0:1787784611.114576:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 223 00000100:00100000:0.0:1787784611.114672:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 224 00000100:00100000:0.0:1787784611.114679:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1218b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728003840:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784611.114710:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1218b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728003840:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 33us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784611.114714:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 224 00000100:00100000:0.0:1787784611.114723:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 225 00000100:00100000:0.0:1787784611.114726:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728004096:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784611.114738:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728004096:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 12us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784611.114742:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 225 00000100:00100000:3.0:1787784611.115240:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728003712 00000100:00100000:3.0:1787784611.115245:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728003712 00000100:00100000:3.0:1787784611.115276:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 338 00000100:00100000:3.0:1787784611.115293:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2405:x1874627728003712:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784611.115326:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2405:x1874627728003712:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 35us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784611.115331:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 338 00000100:00080000:3.0:1787784611.115352:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784611.115356:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784611.115956:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1219680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728004224:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784611.116001:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1219680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728004224:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 1419us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784611.116006:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 223 00010000:00010000:3.0:1787784611.333951:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784611.974174:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750110976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784611.974269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784611.974369:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750110976 00000100:00100000:3.0:1787784611.974381:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750110976 00000100:00100000:3.0:1787784611.974448:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787784611.974459:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750110976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784611.974497:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784611.974543:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750110976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784611.974552:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1787784611.974573:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787784611.974608:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36d30c0 x1874627750110976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784611.974629:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750110976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784611.975139:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750111232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784611.975184:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784611.975235:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750111232 00000100:00100000:2.0:1787784611.975240:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750111232 00000100:00100000:2.0:1787784611.975271:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787784611.975277:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750111232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784611.975308:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787784611.975344:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750111232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784611.975350:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787784611.975379:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750111232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784611.975460:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750111104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784611.975487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784611.976100:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750111104 00000100:00100000:2.0:1787784611.976105:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750111104 00000100:00100000:2.0:1787784611.976355:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787784611.976364:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750111104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784611.976383:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784611.976434:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750111104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784611.976441:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1787784611.976479:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787784611.977546:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48cb40 x1874627750111104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784611.977598:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750111104:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787784612.261210:0:13538:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 18:50:10 (1787784610) === 00010000:00010000:3.0:1787784612.357928:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784612.489382:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750111360:0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.489490:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784612.490820:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750111872:0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.490897:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784612.490948:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750112384:0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.490981:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784612.491038:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787784612.491046:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750111744:0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.491074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784612.491095:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750112256:0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.491117:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784612.491156:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750111488:0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.491186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784612.491208:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750112000:0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.491233:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784612.491252:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750112512:0@lo:400:kworker.0 00000100:00100000:0.0:1787784612.491492:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750111872 00000100:00100000:0.0:1787784612.491503:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750111872 00000100:00100000:0.0:1787784612.491578:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750111744 00000100:00100000:0.0:1787784612.491582:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750111744 00000100:00100000:0.0:1787784612.491600:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750112256 00000100:00100000:0.0:1787784612.491603:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750112256 00000100:00100000:0.0:1787784612.491616:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750111488 00000100:00100000:0.0:1787784612.491618:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750111488 00000100:00100000:0.0:1787784612.491629:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750112000 00000100:00100000:0.0:1787784612.491632:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750112000 00000100:00100000:0.0:1787784612.491653:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787784612.491663:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750111872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784612.491758:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750111872:12345-0@lo:400:kworker.0 Request processed in 88us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784612.491836:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787784612.491859:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787784612.491866:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff475a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750111744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784612.491896:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff475a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750111744:12345-0@lo:400:kworker.0 Request processed in 31us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784612.491901:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787784612.491911:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787784612.491946:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff477c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750112256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784612.491973:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff477c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750112256:12345-0@lo:400:kworker.0 Request processed in 29us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784612.491979:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787784612.492000:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787784612.492006:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff477840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750111488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784612.492034:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff477840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750111488:12345-0@lo:400:kworker.0 Request processed in 29us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784612.492041:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787784612.492051:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787784612.492057:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff474f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750112000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784612.492099:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff474f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750112000:12345-0@lo:400:kworker.0 Request processed in 42us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784612.492106:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:0.0:1787784612.492133:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787784612.492138:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784612.492365:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784612.492463:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750111488:0@lo:400:kworker.0 00010000:00080000:1.0:1787784612.492621:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48cb40 x1874627750112000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784612.492635:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750112000:0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.492659:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787784612.492671:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750111616:0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.492729:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784612.492795:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750112128:0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.492826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784612.492851:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750112640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784612.492882:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784612.492958:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750111360 00000100:00100000:1.0:1787784612.492965:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750111360 00000100:00100000:1.0:1787784612.493111:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787784612.493127:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750111360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.493178:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750111360:12345-0@lo:400:kworker.0 Request processed in 59us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784612.493192:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787784612.493236:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750112384 00000100:00100000:1.0:1787784612.493241:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750112384 00000100:00100000:1.0:1787784612.493287:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750112512 00000100:00100000:1.0:1787784612.493290:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750112512 00000100:00100000:1.0:1787784612.493423:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787784612.493432:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff476d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750112384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784612.493600:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787784612.493611:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750112512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784612.493692:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750112512:12345-0@lo:400:kworker.0 Request processed in 77us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784612.493700:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1787784612.493727:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787784612.493761:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c19f4b40 x1874627750112512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784612.493796:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750112512:0@lo:400:kworker.0 00000100:00100000:0.0:1787784612.493829:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750112128 00000100:00100000:0.0:1787784612.493834:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750112128 00000100:00100000:0.0:1787784612.493881:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787784612.493888:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750112128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784612.493948:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750112128:12345-0@lo:400:kworker.0 Request processed in 61us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784612.493955:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:0.0:1787784612.493970:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784612.493989:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750112128:0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.494423:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff476d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750112384:12345-0@lo:400:kworker.0 Request processed in 991us (3439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784612.494432:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787784612.494605:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750111616 00000100:00100000:1.0:1787784612.494611:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750111616 00000100:00100000:1.0:1787784612.494711:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787784612.494719:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff475e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750111616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.494782:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff475e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750111616:12345-0@lo:400:kworker.0 Request processed in 49us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784612.494788:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787784612.496986:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750112768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784612.497156:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784612.497231:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750112640 00000100:00100000:2.0:1787784612.497243:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750112640 00000100:00100000:2.0:1787784612.497299:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750112768 00000100:00100000:2.0:1787784612.497374:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750112768 00000100:00100000:2.0:1787784612.497400:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787784612.497409:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750112640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787784612.497448:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784612.497586:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750112640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 177us (4702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784612.497609:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787784612.497629:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787784612.497635:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750112768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784612.497645:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784612.497679:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750112768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784612.497685:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1787784612.497726:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c1218000 x1874627750112768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784612.497747:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750112768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784612.500458:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750111744:0@lo:400:kworker.0 00010000:00080000:3.0:1787784612.501103:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48f0c0 x1874627750112256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784612.501118:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750112256:0@lo:400:kworker.0 00000100:00100000:3.0:1787784612.501138:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750111360:0@lo:400:kworker.0 00000100:00100000:3.0:1787784612.501154:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750111872:0@lo:400:kworker.0 00010000:00080000:3.0:1787784612.501170:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2665e00 x1874627750112384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784612.501180:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2665e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750112384:0@lo:400:kworker.0 00000100:00100000:1.0:1787784612.512288:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750111616:0@lo:400:kworker.0 00010000:00080000:1.0:1787784612.512384:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d9e13c00 x1874627750112640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784612.512411:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750112640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784612.559522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784612.559591:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784612.559632:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728004480 00000100:00100000:0.0:1787784612.559643:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728004480 00000100:00100000:0.0:1787784612.559707:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:0.0:1787784612.559719:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:10506:x1874627728004480:12345-192.168.202.41@tcp:700:mkdir.0 00000100:00100000:0.0:1787784612.559852:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:10506:x1874627728004480:12345-192.168.202.41@tcp:700:mkdir.0 Request processed in 134us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784612.559860:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:0.0:1787784612.562279:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728004352 00000100:00100000:0.0:1787784612.562301:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728004352 00000100:00100000:0.0:1787784612.562393:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:0.0:1787784612.562407:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627728004352:12345-192.168.202.41@tcp:41:mkdir.0 00000004:00000024:0.0:1787784612.562463:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784612.562582:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627728004352:12345-192.168.202.41@tcp:41:mkdir.0 Request processed in 178us (2990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784612.562591:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1787784612.566171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784612.566509:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728004736 00000100:00100000:3.0:1787784612.566523:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728004736 00000100:00100000:3.0:1787784612.566608:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:3.0:1787784612.566622:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff476580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:10506:x1874627728004736:12345-192.168.202.41@tcp:36:mkdir.0 00010000:00010000:3.0:1787784612.566703:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784612.566939:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9cd47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728c5 expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.566997:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c23c8400) 00010000:00010000:3.0:1787784612.567023:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784612.567129:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cea5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.567234:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cea5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.567244:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cea5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.567274:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9ceac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.567282:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9ceac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.567290:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9ceac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.571361:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ceb3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.571438:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ceb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.571451:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ceb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784612.571478:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000158977a reply state 000000004361f326 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ceb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.571491:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ceb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.571498:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d500) 00010000:00010000:3.0:1787784612.571501:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787784612.571521:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787784612.571528:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787784612.571538:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cea5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.571544:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cea5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.571551:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cea5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.571557:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784612.571560:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cea5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.571567:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cea5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.571577:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f512d600) 00010000:00010000:3.0:1787784612.571581:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784612.571584:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cea5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.571590:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cea5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784612.571611:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000158977a reply state 000000004361f326 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9ceac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.571619:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9ceac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.571625:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8951f512d900) 00010000:00010000:3.0:1787784612.571636:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787784612.571640:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787784612.571760:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff476580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:10506:x1874627728004736:12345-192.168.202.41@tcp:36:mkdir.0 Request processed in 5136us (5600us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787784612.571809:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:0.0:1787784612.594073:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784612.594305:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728004864 00000100:00100000:1.0:1787784612.594319:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728004864 00000100:00100000:1.0:1787784612.594397:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1787784612.594411:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:10507:x1874627728004864:12345-192.168.202.41@tcp:101:chmod.0 00010000:00010000:1.0:1787784612.594443:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784612.594479:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ceba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72958 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.594580:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cec1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.594616:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.594632:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784612.594697:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787784612.594701:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787784612.594748:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.595030:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ceba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72958 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.595053:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cec1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72958 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.595064:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c3352700) 00010000:00010000:1.0:1787784612.595067:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784612.595071:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602800, rc 0) 00000100:00100000:1.0:1787784612.595149:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:10507:x1874627728004864:12345-192.168.202.41@tcp:101:chmod.0 Request processed in 742us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784612.595157:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:0.0:1787784612.607391:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784612.607456:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728005120 00000100:00100000:2.0:1787784612.607471:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728005120 00000100:00100000:2.0:1787784612.607561:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:2.0:1787784612.607575:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff457840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+8:10507:x1874627728005120:12345-192.168.202.41@tcp:36:chmod.0 00010000:00010000:2.0:1787784612.607654:0:11332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784612.607694:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cec1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72958 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.607720:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c3352700) 00010000:00010000:2.0:1787784612.607734:0:11332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784612.607808:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cec8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.607826:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cec8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.607875:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cec8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784612.608166:0:11332:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a97ab8aa reply state 0000000078e0a1ec transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cec8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.608181:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cec8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.608189:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951d9fc8700) 00010000:00010000:2.0:1787784612.608193:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787784612.608196:0:11332:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787784612.608207:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787784612.608343:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff457840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+9:10507:x1874627728005120:12345-192.168.202.41@tcp:36:chmod.0 Request processed in 769us (967us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787784612.608351:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:3.0:1787784612.632093:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784612.632715:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728005248 00000100:00100000:1.0:1787784612.632729:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728005248 00000100:00100000:1.0:1787784612.633015:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:1.0:1787784612.633029:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+9:10508:x1874627728005248:12345-192.168.202.41@tcp:101:chown.0 00010000:00010000:1.0:1787784612.633064:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784612.633112:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9cecf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7295f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.633208:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9ced6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.633227:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9ced6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.633241:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9ced6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784612.633450:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787784612.633455:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787784612.633506:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9ced6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.633661:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9cecf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7295f expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.633687:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9ced6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7295f expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.633697:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951d9fc8700) 00010000:00010000:1.0:1787784612.633701:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784612.633705:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603c00, rc 0) 00000100:00100000:1.0:1787784612.634817:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+10:10508:x1874627728005248:12345-192.168.202.41@tcp:101:chown.0 Request processed in 1783us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784612.634831:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:0.0:1787784612.639937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784612.640239:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728005376 00000100:00100000:1.0:1787784612.640270:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728005376 00000100:00100000:1.0:1787784612.640348:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:1.0:1787784612.640361:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+10:10508:x1874627728005376:12345-192.168.202.41@tcp:101:chown.0 00010000:00010000:1.0:1787784612.640389:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784612.640416:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cedd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72966 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.640510:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cee4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.640530:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.640557:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.640678:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ceeb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.640688:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ceeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.640695:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ceeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.640829:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cef2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.640837:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641049:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784612.641116:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787784612.641121:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787784612.641146:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641161:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641168:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cee4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641175:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cee4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641183:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784612.641188:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cee4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641198:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cee4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641213:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951d9fc8700) 00010000:00010000:1.0:1787784612.641217:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784612.641223:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cee4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641231:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cee4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641246:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ceeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641263:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ceeb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641269:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ceeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641274:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784612.641278:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ceeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641284:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ceeb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641293:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8951f512d900) 00010000:00010000:1.0:1787784612.641296:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784612.641299:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ceeb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641305:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ceeb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641339:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cedd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72966 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641355:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cef2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72966 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.641362:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d500) 00010000:00010000:1.0:1787784612.641365:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784612.641373:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603400, rc 0) 00000100:00100000:1.0:1787784612.641470:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+11:10508:x1874627728005376:12345-192.168.202.41@tcp:101:chown.0 Request processed in 1110us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784612.641480:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:2.0:1787784612.645884:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784612.646060:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728005504 00000100:00100000:0.0:1787784612.646073:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728005504 00000100:00100000:0.0:1787784612.646148:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:0.0:1787784612.646161:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e90d38f-8956-47bc-80da-c902c22ae09c+11:10508:x1874627728005504:12345-192.168.202.41@tcp:900:chown.0 00000100:00100000:0.0:1787784612.646286:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e90d38f-8956-47bc-80da-c902c22ae09c+11:10508:x1874627728005504:12345-192.168.202.41@tcp:900:chown.0 Request processed in 127us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784612.646294:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:2.0:1787784612.650906:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784612.651198:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728005760 00000100:00100000:1.0:1787784612.651212:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728005760 00000100:00100000:1.0:1787784612.651293:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:1.0:1787784612.651306:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+11:10508:x1874627728005760:12345-192.168.202.41@tcp:36:chown.0 00010000:00010000:1.0:1787784612.651386:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784612.651423:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cef2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72966 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.651446:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d500) 00010000:00010000:1.0:1787784612.651454:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784612.651484:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cef9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.651501:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cef9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.651512:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cef9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784612.659687:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1787784612.660047:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adec0ad9 reply state 00000000e092d6f2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cef9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.660076:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cef9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660085:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9ceac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.660087:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d500) 00010000:00010000:3.0:1787784612.660100:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787784612.660107:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787784612.660110:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9ceac lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784612.660122:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787784612.660123:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9ceac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660137:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784612.660143:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9ceac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660174:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9ceac lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660193:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8951f512d900) 00010000:00010000:2.0:1787784612.660197:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784612.660202:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9ceac lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660210:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9ceac lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787784612.660237:0:6523:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1787784612.660240:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ceb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660249:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ceb3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784612.660266:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+9:10508:x1874627728005760:12345-192.168.202.41@tcp:36:chown.0 Request processed in 8956us (9367us total) trans 4294967301 rc 0/0 00010000:00010000:2.0:1787784612.660289:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ceb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784612.660299:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00010000:00010000:2.0:1787784612.660305:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784612.660311:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ceb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660319:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ceb3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660332:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d500) 00010000:00010000:2.0:1787784612.660335:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784612.660339:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ceb3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660356:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ceb3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660373:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cec8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660380:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cec8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660386:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cec8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660391:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5bc00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784612.660394:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cec8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660400:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cec8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660408:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951d9fc8700) 00010000:00010000:2.0:1787784612.660411:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787784612.660414:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cec8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.660419:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cec8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.660677:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cef9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.660686:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cef9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.660691:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cef9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.660702:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784612.660705:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cef9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.660712:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cef9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.660721:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d500) 00010000:00010000:1.0:1787784612.660723:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787784612.660726:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cef9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.660731:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cef9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784612.696209:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784612.700553:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728005888 00000100:00100000:3.0:1787784612.700580:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728005888 00000100:00100000:3.0:1787784612.700658:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:3.0:1787784612.700670:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:10509:x1874627728005888:12345-192.168.202.41@tcp:101:touch.500 00010000:00010000:3.0:1787784612.700696:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784612.700719:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cf00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7296d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787784612.702067:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1242us 00010000:00010000:3.0:1787784612.714621:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9cf07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.714648:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9cf07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.714659:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9cf07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.714672:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9cf0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.714677:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9cf0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.714681:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9cf0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.714854:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9cf15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.714860:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9cf15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.714865:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9cf15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784612.714894:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787784612.714897:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787784612.714955:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9cf15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.714971:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9cf07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716105:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9cf07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716111:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9cf07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716116:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784612.716120:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9cf07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716127:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9cf07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716141:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951d9fc8700) 00010000:00010000:3.0:1787784612.716144:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784612.716148:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9cf07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716153:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9cf07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716163:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9cf0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716166:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9cf0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716170:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9cf0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716173:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784612.716179:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9cf0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716184:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9cf0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716188:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8951f512d600) 00010000:00010000:3.0:1787784612.716189:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784612.716191:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9cf0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716194:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9cf0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716241:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cf00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7296d expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716251:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9cf15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7296d expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.716256:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d100) 00010000:00010000:3.0:1787784612.716257:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787784612.716258:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712e00, rc 0) 00000100:00100000:3.0:1787784612.716400:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:10509:x1874627728005888:12345-192.168.202.41@tcp:101:touch.500 Request processed in 15731us (20208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784612.716411:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:0.0:1787784612.719458:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784612.719585:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728006144 00000100:00100000:1.0:1787784612.719596:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728006144 00000100:00100000:1.0:1787784612.719667:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:1.0:1787784612.719679:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff456580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:10509:x1874627728006144:12345-192.168.202.41@tcp:101:touch.500 00010000:00010000:1.0:1787784612.719705:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784612.719730:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf1c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72974 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.719930:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cf23 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.719948:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cf23 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.719979:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cf23 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.720190:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9cf2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.720213:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9cf2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.720228:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9cf2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787784612.720671:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787784612.722380:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cf31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.722400:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cf31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.722411:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cf31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.722471:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cf23 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.722479:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cf23 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.722485:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cf23 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.722492:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784612.722508:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cf23 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.722517:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cf23 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.722531:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d100) 00010000:00010000:1.0:1787784612.722535:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784612.722539:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cf23 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.722545:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9cf23 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784612.722561:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000892f9187 reply state 00000000792c6590 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9cf2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.722571:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9cf2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.722576:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff8950c3352d00) 00010000:00010000:1.0:1787784612.722578:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787784612.722581:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787784612.722625:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf1c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72974 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.722639:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cf31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72974 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.722645:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8950c3352300) 00010000:00010000:1.0:1787784612.722647:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784612.722655:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602800, rc 0) 00000100:00100000:1.0:1787784612.722739:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff456580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+10:10509:x1874627728006144:12345-192.168.202.41@tcp:101:touch.500 Request processed in 3062us (3294us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787784612.722750:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:2.0:1787784612.732673:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784612.733149:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728006400 00000100:00100000:3.0:1787784612.733163:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728006400 00000100:00100000:1.0:1787784612.733524:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:1.0:1787784612.733548:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+10:10509:x1874627728006400:12345-192.168.202.41@tcp:36:touch.500 00010000:00010000:1.0:1787784612.733609:0:11332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784612.733639:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9cf31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72974 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.733660:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8950c3352300) 00010000:00010000:1.0:1787784612.733672:0:11332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784612.733723:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.733734:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.733743:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784612.734021:0:11332:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f17fee0f reply state 000000001c6d2529 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.734034:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.734041:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8950c3352000) 00010000:00010000:1.0:1787784612.734044:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787784612.734061:0:11332:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784612.734310:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+11:10509:x1874627728006400:12345-192.168.202.41@tcp:36:touch.500 Request processed in 772us (1651us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787784612.734318:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:0.0:1787784612.738407:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784612.738640:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728006528 00000100:00100000:3.0:1787784612.738652:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728006528 00000100:00100000:3.0:1787784612.738745:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:3.0:1787784612.738757:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+11:10509:x1874627728006528:12345-192.168.202.41@tcp:101:touch.500 00010000:00010000:3.0:1787784612.739125:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784612.739156:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cf46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7297b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.739238:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cf46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7297b expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.739258:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cf46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7297b expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784612.739400:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8950c3352000) 00010000:00010000:3.0:1787784612.739405:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787784612.739410:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713800, rc 0) 00000100:00100000:2.0:1787784612.739744:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+12:10509:x1874627728006528:12345-192.168.202.41@tcp:101:touch.500 Request processed in 987us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784612.739755:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:0.0:1787784612.743352:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784612.743629:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728006656 00000100:00100000:2.0:1787784612.743641:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728006656 00000100:00100000:2.0:1787784612.743700:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:2.0:1787784612.743710:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2404:x1874627728006656:12345-192.168.202.41@tcp:8:touch.500 00010000:00080000:2.0:1787784612.743758:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp t0 exp 0000000000000000 cur 352 last 0 00000020:00000080:2.0:1787784612.744044:0:8437:0:(genops.c:1385:class_connect()) connect: client 2e90d38f-8956-47bc-80da-c902c22ae09c, cookie 0x88ace7295d9cf4d 00002000:00100000:2.0:1787784612.744063:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e90d38f-8956-47bc-80da-c902c22ae09c/ffff8950c344d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787784612.744079:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787784612.744188:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787784612.744232:0:8437:0:(import.c:65:import_set_state_nolock()) ffff8950c344b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784612.744468:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2404:x1874627728006656:12345-192.168.202.41@tcp:8:touch.500 Request processed in 748us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784612.744479:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1787784612.751354:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784612.751516:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728006784 00000100:00100000:0.0:1787784612.751526:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728006784 00000100:00100000:0.0:1787784612.751597:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:0.0:1787784612.751606:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff476940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:0:x1874627728006784:12345-192.168.202.41@tcp:2:touch.500 00000100:00080000:2.0:1787784612.752166:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787784612.754548:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1787784612.754568:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00000100:00100000:0.0:1787784612.754905:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff476940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:0:x1874627728006784:12345-192.168.202.41@tcp:2:touch.500 Request processed in 3290us (3551us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787784612.754943:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:0.0:1787784612.762316:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784612.762454:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728007040 00000100:00100000:2.0:1787784612.762469:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728007040 00000100:00100000:2.0:1787784612.762551:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:2.0:1787784612.762564:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+12:10509:x1874627728007040:12345-192.168.202.41@tcp:35:touch.500 00000100:00100000:2.0:1787784612.763218:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+13:10509:x1874627728007040:12345-192.168.202.41@tcp:35:touch.500 Request processed in 654us (916us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787784612.763228:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:1.0:1787784612.803072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784612.808551:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728007168 00000100:00100000:2.0:1787784612.808568:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728007168 00000100:00100000:2.0:1787784612.808641:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:2.0:1787784612.808652:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+13:10510:x1874627728007168:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:2.0:1787784612.808679:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784612.808715:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cf54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72982 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.808816:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9cf5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.808833:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9cf5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.808849:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9cf5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784612.809027:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787784612.809031:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787784612.809072:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9cf5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.809100:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cf54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72982 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.809116:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9cf5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72982 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.809123:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d100) 00010000:00010000:2.0:1787784612.809125:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784612.809127:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5be00, rc 0) 00000100:00100000:2.0:1787784612.809408:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+14:10510:x1874627728007168:12345-192.168.202.41@tcp:101:rm.0 Request processed in 755us (6346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784612.809415:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:0.0:1787784612.813087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784612.813191:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728007424 00000100:00100000:1.0:1787784612.813200:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728007424 00000100:00100000:1.0:1787784612.813263:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:1.0:1787784612.813273:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+14:10510:x1874627728007424:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:1.0:1787784612.813293:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784612.813313:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9cf62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72989 expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784612.813411:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787784612.813515:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9cf62 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72989 expref: 16 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.813529:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951d9fc8700) 00010000:00010000:1.0:1787784612.813531:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787784612.813536:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9cf62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72989 expref: 16 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.813549:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603000, rc 0) 00000100:00100000:1.0:1787784612.813608:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+15:10510:x1874627728007424:12345-192.168.202.41@tcp:101:rm.0 Request processed in 337us (531us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1787784612.813616:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:0.0:1787784612.819246:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784612.823430:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728007552 00000100:00100000:2.0:1787784612.823462:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728007552 00000100:00100000:3.0:1787784612.827461:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:3.0:1787784612.827476:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+15:10510:x1874627728007552:12345-192.168.202.41@tcp:37:rm.0 00000100:00100000:0.0:1787784612.839763:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+15:10510:x1874627728007552:12345-192.168.202.41@tcp:37:rm.0 Request processed in 12278us (20991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784612.839937:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:0.0:1787784612.851508:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784612.851713:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728007808 00000100:00100000:2.0:1787784612.851722:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728007808 00000100:00100000:2.0:1787784612.851863:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:2.0:1787784612.851884:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f0043850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+15:10510:x1874627728007808:12345-192.168.202.41@tcp:35:rm.0 00000100:00100000:2.0:1787784612.852154:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f0043850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+16:10510:x1874627728007808:12345-192.168.202.41@tcp:35:rm.0 Request processed in 272us (655us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787784612.852452:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:1.0:1787784612.856655:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784612.857112:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728008064 00000100:00100000:2.0:1787784612.857122:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728008064 00000100:00100000:2.0:1787784612.857292:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:2.0:1787784612.857303:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff475680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+16:10510:x1874627728008064:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:2.0:1787784612.857328:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784612.857353:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cf70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72990 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.857457:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9cf77 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.857472:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9cf77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.857483:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9cf77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784612.857494:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787784612.857615:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cf70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72990 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.857649:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9cf77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72990 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.857657:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d100) 00010000:00010000:2.0:1787784612.857661:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787784612.857664:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a800, rc 0) 00000100:00100000:2.0:1787784612.857728:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff475680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+18:10510:x1874627728008064:12345-192.168.202.41@tcp:101:rm.0 Request processed in 428us (1085us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787784612.857736:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:3.0:1787784612.861681:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784612.861831:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728008192 00000100:00100000:1.0:1787784612.861852:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728008192 00000100:00100000:1.0:1787784612.861928:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:1.0:1787784612.861938:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+18:10510:x1874627728008192:12345-192.168.202.41@tcp:41:rm.0 00000004:00000024:1.0:1787784612.861998:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1787784612.862068:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+18:10510:x1874627728008192:12345-192.168.202.41@tcp:41:rm.0 Request processed in 132us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784612.862076:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:0.0:1787784612.866225:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784612.866384:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728008320 00000100:00100000:1.0:1787784612.866394:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728008320 00000100:00100000:1.0:1787784612.866453:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:1.0:1787784612.866463:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+18:10510:x1874627728008320:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:1.0:1787784612.866484:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784612.866504:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9cf85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72997 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.866570:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9cf8c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.866586:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9cf8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.866597:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9cf8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.866608:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9cf93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.866615:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9cf93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.866636:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9cf93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.866750:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9cf9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.866760:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9cf9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.866816:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9cf9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784612.867335:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787784612.867342:0:7991:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787784612.867364:0:7991:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9cf9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867376:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9cf9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867385:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9cf8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867392:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9cf8c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867398:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9cf8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867404:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784612.867408:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9cf8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867427:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9cf8c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867439:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d100) 00010000:00010000:1.0:1787784612.867442:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784612.867446:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9cf8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867452:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9cf8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867465:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9cf93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867470:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9cf93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867475:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9cf93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867480:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784612.867483:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9cf93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867489:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9cf93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867496:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff8950c3352d00) 00010000:00010000:1.0:1787784612.867499:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784612.867502:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9cf93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867517:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9cf93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867545:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9cf85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72997 expref: 20 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867557:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9cf9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72997 expref: 19 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784612.867565:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8950c3352000) 00010000:00010000:1.0:1787784612.867567:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784612.867632:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602c00, rc 0) 00000100:00100000:1.0:1787784612.867756:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+19:10510:x1874627728008320:12345-192.168.202.41@tcp:101:rm.0 Request processed in 1292us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784612.867765:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:0.0:1787784612.871507:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784612.871724:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728008576 00000100:00100000:2.0:1787784612.871735:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728008576 00000100:00100000:2.0:1787784612.872446:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:2.0:1787784612.872460:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+19:10510:x1874627728008576:12345-192.168.202.41@tcp:36:rm.0 00010000:00010000:2.0:1787784612.872512:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787784612.872538:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9cf9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72997 expref: 19 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.872560:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9cf46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7297b expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.872647:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8950c3352000) 00010000:00010000:2.0:1787784612.872660:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9cf5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72982 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.872669:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d100) 00010000:00010000:2.0:1787784612.872686:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784612.872707:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cfa1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.872721:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cfa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.872731:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cfa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.872742:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9cfa8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.872751:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9cfa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.872757:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9cfa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873091:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9cfaf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873101:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9cfaf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873109:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9cfaf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784612.873400:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787784612.873410:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353122641683ns, next at 354122638206ns, rc = 0 00010000:00010000:2.0:1787784612.873456:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cfb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873477:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cfb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873485:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cfb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873492:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cfb6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873498:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cfb6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873505:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cfb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873596:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784612.873616:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9cfaf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873622:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9cfaf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873628:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9cfaf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873633:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784612.873637:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9cfaf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873645:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9cfaf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873665:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8950c3352000) 00010000:00010000:2.0:1787784612.873668:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787784612.873672:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9cfaf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873678:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9cfaf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873696:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cfa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873702:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cfa1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873708:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cfa1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873712:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784612.873715:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cfa1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873720:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cfa1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873727:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d100) 00010000:00010000:2.0:1787784612.873729:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784612.873732:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cfa1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873737:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9cfa1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784612.873755:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000957a3013 reply state 00000000d76800d6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9cfa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873813:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9cfa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.873822:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff8950c3352d00) 00010000:00010000:2.0:1787784612.873824:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784612.873827:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784612.874015:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+18:10510:x1874627728008576:12345-192.168.202.41@tcp:36:rm.0 Request processed in 1557us (2515us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787784612.874023:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00010000:00010000:0.0:1787784612.877413:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784612.877428:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cfb6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784612.877439:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5bc00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784612.877443:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cfb6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784612.877452:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cfb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784612.877470:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8950c3352000) 00010000:00010000:0.0:1787784612.877473:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787784612.877478:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cfb6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784612.877483:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9cfb6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784612.877520:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784612.877522:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784612.877523:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784612.878236:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784612.878563:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728008832 00000100:00100000:0.0:1787784612.878586:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728008832 00000100:00100000:0.0:1787784612.878644:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:0.0:1787784612.878655:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+18:10510:x1874627728008832:12345-192.168.202.41@tcp:35:rm.0 00000100:00100000:0.0:1787784612.878931:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+19:10510:x1874627728008832:12345-192.168.202.41@tcp:35:rm.0 Request processed in 276us (770us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787784612.878939:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:1.0:1787784612.883880:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784612.884059:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728009088 00000100:00100000:2.0:1787784612.884070:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728009088 00000100:00100000:2.0:1787784612.884122:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:2.0:1787784612.884131:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+19:10510:x1874627728009088:12345-192.168.202.41@tcp:36:rm.0 00010000:00010000:2.0:1787784612.884202:0:11332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787784612.884232:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9cf77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72990 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884254:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9cf15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7296d expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884277:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951f512d100) 00010000:00010000:2.0:1787784612.884295:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9ced6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7295f expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884324:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951d9fc8700) 00010000:00010000:2.0:1787784612.884332:0:11332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784612.884356:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fee00/0x88ace7295d9cfbd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884368:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fee00/0x88ace7295d9cfbd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884379:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fee00/0x88ace7295d9cfbd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884391:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fec00/0x88ace7295d9cfc4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884397:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fec00/0x88ace7295d9cfc4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884403:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fec00/0x88ace7295d9cfc4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884494:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9cfcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884503:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9cfcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884510:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9cfcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784612.884758:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787784612.884807:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9cfcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884821:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9cfcb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884827:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9cfcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884833:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c13ff000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784612.884838:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9cfcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884846:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9cfcb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884855:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8951fb23e700) 00010000:00010000:2.0:1787784612.884858:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787784612.884861:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9cfcb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884867:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9cfcb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884888:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fee00/0x88ace7295d9cfbd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884895:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fee00/0x88ace7295d9cfbd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884900:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fee00/0x88ace7295d9cfbd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884905:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c13fee00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784612.884924:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fee00/0x88ace7295d9cfbd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884931:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fee00/0x88ace7295d9cfbd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884939:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951fb23e300) 00010000:00010000:2.0:1787784612.884941:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784612.884944:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fee00/0x88ace7295d9cfbd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884949:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fee00/0x88ace7295d9cfbd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784612.884962:0:11332:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045352c74 reply state 000000006d1a9851 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fec00/0x88ace7295d9cfc4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884973:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fec00/0x88ace7295d9cfc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784612.884979:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8951fb23ee00) 00010000:00010000:2.0:1787784612.884981:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784612.884984:0:11332:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784612.885063:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+18:10510:x1874627728009088:12345-192.168.202.41@tcp:36:rm.0 Request processed in 932us (1193us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787784612.885071:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00010000:00010000:3.0:1787784613.384522:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784614.022131:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750112896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787784614.022217:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784614.022549:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750112896 00000100:00100000:0.0:1787784614.022557:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750112896 00000100:00100000:0.0:1787784614.022615:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787784614.022625:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750112896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784614.022667:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784614.022736:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750112896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784614.022744:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787784614.022893:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750112896:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784614.410103:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784615.432850:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784616.224937:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784616.225006:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784616.225043:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784616.225150:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728009216 00000100:00100000:1.0:1787784616.225162:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728009216 00000100:00100000:1.0:1787784616.225219:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 340 00000100:00100000:1.0:1787784616.225228:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728009216:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784616.225302:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728009216:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 75us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784616.225310:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 340 00000100:00100000:3.0:1787784616.225546:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784616.227460:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784616.227490:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784616.227601:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728009472 00000100:00100000:2.0:1787784616.227610:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728009472 00000100:00100000:2.0:1787784616.227679:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728009728 00000100:00100000:2.0:1787784616.227683:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728009728 00000100:00100000:2.0:1787784616.227702:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728009344 00000100:00100000:2.0:1787784616.227705:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728009344 00000100:00100000:2.0:1787784616.227734:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 232 00000100:00100000:2.0:1787784616.227741:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2665e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728009472:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784616.227820:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2665e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728009472:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 79us (2813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784616.227842:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 232 00000100:00100000:2.0:1787784616.227858:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 233 00000100:00100000:2.0:1787784616.227864:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728009728:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784616.227899:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728009728:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 35us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784616.227905:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 233 00000100:00100000:2.0:1787784616.227915:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 234 00000100:00100000:2.0:1787784616.227920:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+18:2408:x1874627728009344:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784616.227942:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+18:2408:x1874627728009344:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784616.227947:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 234 00000100:00080000:2.0:1787784616.227963:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784616.227967:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784616.231737:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728009600 00000100:00100000:2.0:1787784616.231756:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728009600 00000100:00100000:2.0:1787784616.232205:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:2.0:1787784616.232217:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728009600:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784616.232303:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728009600:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 88us (4849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784616.232310:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00080000:2.0:1787784616.232336:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784616.235055:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728009856 00000100:00100000:2.0:1787784616.235072:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728009856 00000100:00100000:2.0:1787784616.235173:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 235 00000100:00100000:2.0:1787784616.235184:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728009856:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784616.235267:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728009856:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 85us (7775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784616.235274:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 235 00000100:00080000:3.0:1787784616.235715:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787784616.453946:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787784617.095171:0:8915:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357344398809ns, next at 358344395199ns, rc = 0 00000100:00100000:1.0:1787784617.095208:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750113024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787784617.095289:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784617.095359:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784617.095366:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750113152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784617.095391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784617.095473:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750113024 00000100:00100000:3.0:1787784617.095481:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750113024 00000100:00100000:3.0:1787784617.095549:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750113152 00000100:00100000:3.0:1787784617.095553:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750113152 00000100:00100000:3.0:1787784617.095572:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787784617.095581:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750113024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784617.095611:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784617.095653:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750113024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784617.095661:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787784617.095677:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787784617.095684:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750113152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784617.095693:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784617.095716:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750113152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784617.095722:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1787784617.095850:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787784617.095887:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48ed00 x1874627750113152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784617.095905:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750113152:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787784617.095918:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c35761c0 x1874627750113024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784617.095928:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750113024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784617.099894:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3574f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750113280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784617.099970:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784617.100104:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750113280 00000100:00100000:3.0:1787784617.100111:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750113280 00000100:00100000:3.0:1787784617.100160:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787784617.100169:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750113280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787784617.100200:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787784617.100246:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750113280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784617.100253:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787784617.100322:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3574f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750113280:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787784617.175369:0:13686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1787784617.478220:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784617.609116:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750113408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784617.609227:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784617.609341:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750113408 00000100:00100000:1.0:1787784617.609350:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750113408 00000100:00100000:1.0:1787784617.609426:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787784617.609438:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750113408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787784617.609476:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784617.609525:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750113408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784617.609534:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1787784617.609557:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787784617.609594:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48ed00 x1874627750113408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784617.609616:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750113408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784617.610351:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750113536:0@lo:400:kworker.0 00000100:00100000:1.0:1787784617.610407:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784617.610449:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750114048:0@lo:400:kworker.0 00000100:00100000:1.0:1787784617.610478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784617.610498:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750114560:0@lo:400:kworker.0 00000100:00100000:2.0:1787784617.610626:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750114048 00000100:00100000:2.0:1787784617.610634:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750114048 00000100:00100000:2.0:1787784617.610699:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787784617.610709:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750114048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784617.610838:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750113536 00000100:00100000:3.0:1787784617.610843:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750113536 00000100:00100000:3.0:1787784617.610888:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787784617.610895:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750113536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784617.610952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784617.611039:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750113536:12345-0@lo:400:kworker.0 Request processed in 144us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784617.611047:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787784617.611464:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750113536:0@lo:400:kworker.0 00000100:00100000:1.0:1787784617.611487:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787784617.611498:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750113664:0@lo:400:kworker.0 00000100:00100000:1.0:1787784617.611547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784617.611576:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750114176:0@lo:400:kworker.0 00000100:00100000:1.0:1787784617.611600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784617.611623:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750114688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784617.611650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784617.611679:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750113664 00000100:00100000:3.0:1787784617.611695:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750113664 00000100:00100000:1.0:1787784617.611700:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750114560 00000100:00100000:1.0:1787784617.611707:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750114560 00000100:00100000:3.0:1787784617.611760:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750114176 00000100:00100000:1.0:1787784617.611803:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787784617.611815:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750114560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784617.611831:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750114176 00000100:00100000:1.0:1787784617.611888:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750114560:12345-0@lo:400:kworker.0 Request processed in 74us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784617.611897:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787784617.611903:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787784617.611916:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750113664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784617.611941:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787784617.611953:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750114176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784617.612012:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750114176:12345-0@lo:400:kworker.0 Request processed in 62us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784617.612032:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750113664:12345-0@lo:400:kworker.0 Request processed in 114us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784617.612041:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787784617.612052:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787784617.612092:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750114688 00000100:00100000:1.0:1787784617.612093:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750113792:0@lo:400:kworker.0 00000100:00100000:3.0:1787784617.612099:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750114688 00000100:00100000:3.0:1787784617.612146:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787784617.612154:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750114688:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784617.612164:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787784617.612176:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784617.612201:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750114304:0@lo:400:kworker.0 00000100:00100000:3.0:1787784617.612235:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750114688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784617.612244:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787784617.612252:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784617.612283:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750113792 00000100:00100000:3.0:1787784617.612287:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750113792 00000100:00100000:3.0:1787784617.612316:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787784617.612323:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750113792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784617.612364:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750113792:12345-0@lo:400:kworker.0 Request processed in 42us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784617.612371:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787784617.612693:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750114048:12345-0@lo:400:kworker.0 Request processed in 1982us (2209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784617.612703:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787784617.612801:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750113792:0@lo:400:kworker.0 00000100:00100000:1.0:1787784617.612819:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787784617.612828:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750113920:0@lo:400:kworker.0 00000100:00100000:1.0:1787784617.612860:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784617.612959:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750114304 00000100:00100000:2.0:1787784617.612964:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750114304 00000100:00100000:1.0:1787784617.615399:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750114432:0@lo:400:kworker.0 00000100:00100000:1.0:1787784617.615475:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784617.615495:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750113920 00000100:00100000:2.0:1787784617.615503:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750113920 00000100:00100000:2.0:1787784617.615562:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787784617.615575:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750114304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784617.615638:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750114304:12345-0@lo:400:kworker.0 Request processed in 67us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784617.615646:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787784617.615675:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787784617.615681:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750113920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784617.615712:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750113920:12345-0@lo:400:kworker.0 Request processed in 31us (2851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784617.615719:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:2.0:1787784617.615860:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784617.615878:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784617.615882:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784617.615941:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750113664:0@lo:400:kworker.0 00010000:00080000:2.0:1787784617.615964:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36c9e00 x1874627750114176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784617.615976:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750114176:0@lo:400:kworker.0 00010000:00080000:2.0:1787784617.615992:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff48ed00 x1874627750114688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784617.616012:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750114688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784617.616027:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750114048:0@lo:400:kworker.0 00010000:00080000:2.0:1787784617.616039:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36c9a40 x1874627750114560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784617.616047:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750114560:0@lo:400:kworker.0 00000100:00100000:1.0:1787784617.616556:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750114304:0@lo:400:kworker.0 00000100:00100000:1.0:1787784617.616576:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750113920:0@lo:400:kworker.0 00000100:00100000:3.0:1787784617.617356:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750114432 00000100:00100000:3.0:1787784617.617374:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750114432 00000100:00100000:3.0:1787784617.619624:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787784617.619639:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750114432:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787784617.619674:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787784617.619840:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36cad00 x1874627750114432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784617.619861:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750114432:0@lo:400:kworker.0 00000100:00100000:3.0:1787784617.620500:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750114432:12345-0@lo:400:kworker.0 Request processed in 130us (4291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784617.620513:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00010000:00010000:1.0:1787784618.513845:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787784618.628073:0:13734:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd29a486f0 20000000:00000080:2.0:1787784618.628099:0:13734:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8950c3437400 uarg=0000000000000000 20000000:01000000:2.0:1787784618.628174:0:13734:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787784618.628183:0:13734:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787784618.628190:0:13734:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000004:00080000:2.0:1787784618.635827:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787784618.635884:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1787784618.635896:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1787784618.635933:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9cf2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.635947:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9cf2a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.635957:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9cf2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.635964:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784618.635971:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9cf2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.635981:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9cf2a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636004:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff8950c3352d00) 00010000:00010000:2.0:1787784618.636007:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784618.636013:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9cf2a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636020:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9cf2a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636044:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636053:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf3f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636076:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636083:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784618.636087:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636095:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf3f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636104:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8950c3352000) 00010000:00010000:2.0:1787784618.636107:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784618.636110:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf3f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636116:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9cf3f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636137:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9cfa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636143:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9cfa8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636148:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9cfa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636152:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ac00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784618.636154:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9cfa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636171:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9cfa8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636180:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff8950c3352d00) 00010000:00010000:2.0:1787784618.636182:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784618.636185:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9cfa8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636190:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9cfa8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787784618.636194:0:13735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00010000:00010000:2.0:1787784618.636207:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fec00/0x88ace7295d9cfc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636214:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fec00/0x88ace7295d9cfc4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636221:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fec00/0x88ace7295d9cfc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636227:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c13fec00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784618.636230:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fec00/0x88ace7295d9cfc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636236:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fec00/0x88ace7295d9cfc4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636245:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8951fb23ee00) 00010000:00010000:2.0:1787784618.636248:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784618.636251:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fec00/0x88ace7295d9cfc4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.636263:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13fec00/0x88ace7295d9cfc4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784618.636295:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784618.636319:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750114816:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787784618.636418:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:02000000:0.0:1787784618.636593:0:13734:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000100:00100000:1.0:1787784618.636985:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750114816 00000100:00100000:1.0:1787784618.636995:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750114816 00000100:00100000:1.0:1787784618.637060:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787784618.637073:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750114816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787784618.637122:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1787784618.637167:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f6da4, atime: 0x6a8f6da4, ctime: 0x6a8f6da4, blocks: 0x0 00010000:00010000:1.0:1787784618.637176:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9cfd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.637194:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1787784618.637199:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784618.637207:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9cfd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.637227:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9cfd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.637237:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9cfd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.637245:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9cfd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.637271:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787784618.637490:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1874627750114816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 419us (1072us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787784618.637500:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787784618.637616:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784618.637626:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9cfd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.637637:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784618.637642:0:10397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9cfd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.637652:0:10397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9cfd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.637672:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9cfd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.637691:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9cfd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.637712:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784618.637714:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784618.637715:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787784618.637835:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8950c36f1680/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787784618.637843:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750114816:0@lo:6:osp-syn-0-0.0 00000040:00080000:2.0:1787784618.644036:0:13734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787784618.644084:0:13734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787784618.644106:0:13734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787784618.644130:0:13734:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787784618.644160:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.644188:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d35c00/0x88ace7295d9ce5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7294a expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.644197:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d34c00/0x88ace7295d9ce66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72951 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.644204:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d35a00/0x88ace7295d9ce74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ce6d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.644212:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951df603800/0x88ace7295d9ce82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ce7b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.644218:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff895201c5a000/0x88ace7295d9ce90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ce89 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.644248:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8950c3713e00/0x88ace7295d9ce9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ce97 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.644257:0:13734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.644313:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8950c3713e00/0x88ace7295d9ce9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ce97 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.644331:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8950c3713e00/0x88ace7295d9ce9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ce97 expref: 23 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784618.644351:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1874627750114944:0@lo:104: 00000100:00100000:2.0:1787784618.644851:0:13734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787784618.644930:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff895201c5a000/0x88ace7295d9ce90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ce89 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.644940:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff895201c5a000/0x88ace7295d9ce90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ce89 expref: 23 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784618.644949:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ca940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1874627750115072:0@lo:104: 00010000:00010000:2.0:1787784618.644976:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951df603800/0x88ace7295d9ce82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ce7b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.644984:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951df603800/0x88ace7295d9ce82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ce7b expref: 23 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784618.644991:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1874627750115200:0@lo:104: 00010000:00010000:2.0:1787784618.645014:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d35a00/0x88ace7295d9ce74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9ce6d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.645031:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951e1d35a00/0x88ace7295d9ce74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9ce6d expref: 23 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784618.645039:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1874627750115328:0@lo:104: 00010000:00010000:2.0:1787784618.645070:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d34c00/0x88ace7295d9ce66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72951 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.645081:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951e1d34c00/0x88ace7295d9ce66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72951 expref: 12 pid: 6513 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784618.645092:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1874627750115456:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784618.645169:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d35c00/0x88ace7295d9ce5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7294a expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.645176:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951e1d35c00/0x88ace7295d9ce5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7294a expref: 12 pid: 6513 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784618.645183:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1874627750115584:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784618.645206:0:13734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e1f8a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784618.645561:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787784618.645586:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784618.645621:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784618.645631:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784618.645641:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750114944 00000100:00100000:3.0:1787784618.645650:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750114944 00000100:00100000:3.0:1787784618.645701:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750115072 00000100:00100000:3.0:1787784618.645704:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750115072 00000100:00100000:3.0:1787784618.645716:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750115200 00000100:00100000:3.0:1787784618.645718:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750115200 00000100:00100000:3.0:1787784618.645726:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750115328 00000100:00100000:3.0:1787784618.645728:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750115328 00000100:00100000:3.0:1787784618.645742:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787784618.645753:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c33db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+6:13734:x1874627750114944:12345-0@lo:104: 00010000:00010000:3.0:1787784618.645791:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.645878:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784618.645884:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c33db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+6:13734:x1874627750114944:12345-0@lo:104: Request processed in 133us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784618.645892:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787784618.645941:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787784618.645958:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+5:13734:x1874627750115072:12345-0@lo:104: 00010000:00010000:3.0:1787784618.645967:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646000:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787784618.646005:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+5:13734:x1874627750115072:12345-0@lo:104: Request processed in 48us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784618.646010:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787784618.646021:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787784618.646026:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:13734:x1874627750115200:12345-0@lo:104: 00010000:00010000:3.0:1787784618.646033:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646064:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787784618.646069:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:13734:x1874627750115200:12345-0@lo:104: Request processed in 43us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784618.646075:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787784618.646087:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787784618.646093:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:13734:x1874627750115328:12345-0@lo:104: 00010000:00010000:3.0:1787784618.646100:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646125:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787784618.646129:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:13734:x1874627750115328:12345-0@lo:104: Request processed in 38us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784618.646136:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1787784618.646157:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787784618.646170:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646178:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784618.646183:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ce9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646193:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ce9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784618.646200:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ce9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784618.646206:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787784618.646247:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646254:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784618.646282:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646291:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff895201c5b800/0x88ace7295d9ce97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646305:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787784618.646308:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646314:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712200 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784618.646317:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ce90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646333:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ce90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784618.646338:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ce90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784618.646343:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787784618.646357:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646363:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784618.646381:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646386:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9ce89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646395:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784618.646398:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646403:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784618.646406:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ce82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646412:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ce82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784618.646418:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ce82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784618.646440:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787784618.646454:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646459:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784618.646465:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646472:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9ce7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646482:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784618.646486:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9ce74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646491:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ba00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784618.646494:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9ce74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646500:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9ce74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784618.646507:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9ce74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784618.646513:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787784618.646526:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646532:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784618.646544:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646550:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff895201c5ba00/0x88ace7295d9ce6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9ce74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.646565:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784618.646567:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784618.646569:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784618.646596:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750115712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784618.646636:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784618.646667:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784618.646672:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750116096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784618.646693:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784618.646719:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750115840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784618.646739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784618.646755:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784618.646760:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3576940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750115968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784618.646804:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784618.646828:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750115712 00000100:00100000:3.0:1787784618.646832:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750115712 00010000:00010000:3.0:1787784618.646868:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8950c3713e00/0x88ace7295d9ce9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ce97 expref: 24 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784618.646886:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750116096 00000100:00100000:3.0:1787784618.646889:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750116096 00010000:00010000:3.0:1787784618.646900:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d35a00/0x88ace7295d9ce74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ce6d expref: 25 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784618.646910:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750115840 00000100:00100000:3.0:1787784618.646920:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750115840 00010000:00010000:3.0:1787784618.646933:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff895201c5a000/0x88ace7295d9ce90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ce89 expref: 26 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784618.646944:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750115968 00000100:00100000:3.0:1787784618.646946:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750115968 00010000:00010000:3.0:1787784618.646956:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951df603800/0x88ace7295d9ce82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ce7b expref: 27 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784618.646968:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787784618.646974:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3576d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+27:3645:x1874627750115712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784618.646985:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784618.646990:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8950c3713e00/0x88ace7295d9ce9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ce97 expref: 27 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.647001:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8950c3713e00/0x88ace7295d9ce9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ce97 expref: 27 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.647023:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784618.647052:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3576d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+27:3645:x1874627750115712:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784618.647058:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787784618.647071:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787784618.647077:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+26:3645:x1874627750116096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784618.647085:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784618.647089:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d35a00/0x88ace7295d9ce74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ce6d expref: 26 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.647097:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d35a00/0x88ace7295d9ce74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ce6d expref: 26 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.647117:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784618.647139:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+26:3645:x1874627750116096:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784618.647144:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787784618.647156:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787784618.647161:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+25:3646:x1874627750115840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784618.647168:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784618.647172:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff895201c5a000/0x88ace7295d9ce90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ce89 expref: 25 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.647180:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff895201c5a000/0x88ace7295d9ce90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ce89 expref: 25 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.647190:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784618.647215:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+25:3646:x1874627750115840:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784618.647221:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787784618.647233:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787784618.647239:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750115968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784618.647246:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784618.647251:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951df603800/0x88ace7295d9ce82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9ce7b expref: 24 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.647260:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951df603800/0x88ace7295d9ce82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9ce7b expref: 24 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.647270:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784618.647298:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750115968:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784618.647304:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787784618.647351:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3576940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750115968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784618.647361:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750115840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784618.647389:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750116096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784618.647397:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750115712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784618.647412:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784618.647959:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3713e00/0x88ace7295d9ce9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ce97 expref: 23 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784618.647974:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1874627750114944:0@lo:104: 00010000:00010000:0.0:1787784618.647986:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5a000/0x88ace7295d9ce90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ce89 expref: 22 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784618.648002:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ca940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1874627750115072:0@lo:104: 00010000:00010000:0.0:1787784618.648014:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df603800/0x88ace7295d9ce82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ce7b expref: 21 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784618.648021:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1874627750115200:0@lo:104: 00010000:00010000:0.0:1787784618.648042:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d35a00/0x88ace7295d9ce74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9ce6d expref: 20 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784618.648051:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1874627750115328:0@lo:104: 00010000:00010000:0.0:1787784618.648092:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784618.652617:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1874627750115456:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784618.654650:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784618.654750:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728009984 00000100:00100000:2.0:1787784618.654758:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784618.654764:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728009984 00010000:00010000:3.0:1787784618.654874:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d34c00/0x88ace7295d9ce66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72951 expref: 13 pid: 6513 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784618.654923:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728010112 00000100:00100000:3.0:1787784618.654927:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728010112 00000100:00100000:0.0:1787784618.654929:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1874627750115584:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784618.654944:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d35c00/0x88ace7295d9ce5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7294a expref: 14 pid: 6513 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784618.654971:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:3.0:1787784618.654984:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65cfdd26-2f8c-42a9-9063-79ee47420602+14:2406:x1874627728009984:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784618.654987:0:13734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.655004:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784618.655013:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d34c00/0x88ace7295d9ce66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72951 expref: 14 pid: 6513 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.655026:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d34c00/0x88ace7295d9ce66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72951 expref: 14 pid: 6513 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.655076:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34c00/0x88ace7295d9ce66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72951 expref: 14 pid: 6513 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784618.655100:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784618.655155:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:1.0:1787784618.655172:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2406:x1874627728010112:12345-192.168.202.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787784618.655180:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2406:x1874627728009984:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 197us (542us total) trans 0 rc 0/0 00010000:00010000:1.0:1787784618.655187:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787784618.655189:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 50 00010000:00010000:1.0:1787784618.655202:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d35c00/0x88ace7295d9ce5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7294a expref: 13 pid: 6513 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.655215:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d35c00/0x88ace7295d9ce5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7294a expref: 12 pid: 6513 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.655232:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d35c00/0x88ace7295d9ce5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7294a expref: 12 pid: 6513 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.655246:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.655256:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.655282:0:8452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.655291:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.655302:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.655310:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.655318:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c13ff600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784618.655323:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.655333:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.655362:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784618.655373:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784618.655395:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+11:2406:x1874627728010112:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 231us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784618.655402:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 51 00010000:00010000:2.0:1787784618.655456:0:13734:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.655465:0:13734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784618.655473:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c13ff600/0x88ace7295d9cfd9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784619.142702:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784619.142948:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750116224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784619.143040:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.143248:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750116224 00000100:00100000:3.0:1787784619.143260:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750116224 00000100:00100000:3.0:1787784619.143356:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787784619.143368:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750116224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784619.143414:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787784619.143483:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750116224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.143493:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787784619.143575:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750116224:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784619.529934:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787784619.793208:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784619.793219:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951f53b5800 from 7 10000000:01000000:3.0:1787784619.793225:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784619.793286:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.793300:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.793313:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.793347:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750116352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.793455:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.793511:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784619.794622:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750116352 00000100:00100000:1.0:1787784619.794636:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750116352 00000100:00100000:1.0:1787784619.794717:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787784619.794741:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750116352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784619.794763:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784619.794800:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df603400/0x88ace7295d9cfe7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cfe0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784619.794835:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603400/0x88ace7295d9cfe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cfe0 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784619.794863:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df603400/0x88ace7295d9cfe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cfe0 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784619.794875:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603400, rc 0) 00000100:00100000:1.0:1787784619.795136:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750116352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 395us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784619.795157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787784619.805705:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750116352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784619.805761:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cfe7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.805810:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cfe7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.807636:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750116480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.807759:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.807836:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784619.808102:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750116480 00000100:00100000:0.0:1787784619.808112:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750116480 00000100:00100000:0.0:1787784619.808194:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787784619.808206:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750116480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784619.808383:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750116480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784619.808392:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1787784619.808586:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750116480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.808636:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750116608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.808700:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.808740:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784619.809087:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750116608 00000100:00100000:0.0:1787784619.809094:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750116608 00000100:00100000:0.0:1787784619.809132:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787784619.809160:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750116608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784619.809272:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750116608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784619.809280:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787784619.809521:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750116608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784619.821347:0:13778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13778:1874627750116736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784619.821469:0:13778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784619.821536:0:13778:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784619.821803:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750116736 00000100:00100000:0.0:1787784619.821813:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750116736 00000100:00100000:0.0:1787784619.821879:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787784619.821891:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:13778:x1874627750116736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784619.822059:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:13778:x1874627750116736:12345-0@lo:502:llog_process_th.0 Request processed in 169us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784619.822067:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787784619.822391:0:13778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13778:1874627750116736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784619.822427:0:13778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784619.822440:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784619.822443:0:13778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787784619.822452:0:13778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951f53b5800 00000020:00000080:3.0:1787784619.822455:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787784619.822555:0:13778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13778:1874627750116864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784619.822603:0:13778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.822637:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750116864 00000100:00100000:3.0:1787784619.822641:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750116864 00000100:00100000:3.0:1787784619.822669:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787784619.822676:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:13778:x1874627750116864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784619.822748:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:13778:x1874627750116864:12345-0@lo:502:llog_process_th.0 Request processed in 72us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.822756:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787784619.822818:0:13778:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784619.822830:0:13778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13778:1874627750116864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784619.822859:0:13778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784619.822865:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784619.822866:0:13778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787784619.822871:0:13778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787784619.836896:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787784619.836968:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784619.836985:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cfe7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.837000:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cfe7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784619.837015:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784619.837018:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951efedf000 from 7 10000000:01000000:3.0:1787784619.837021:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784619.837079:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.837089:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.837127:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.837161:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750116992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.837264:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.837320:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784619.837349:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750116992 00000100:00100000:3.0:1787784619.837357:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750116992 00000100:00100000:3.0:1787784619.837416:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787784619.837425:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750116992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784619.837443:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784619.837458:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3712800/0x88ace7295d9cff5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cfee expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.837489:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3712800/0x88ace7295d9cff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cfee expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.837502:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3712800/0x88ace7295d9cff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cfee expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.837512:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712800, rc 0) 00000100:00100000:3.0:1787784619.837557:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750116992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.837565:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787784619.837624:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750116992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784619.837638:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cff5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.837654:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cff5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.837722:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750117120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.837749:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.844823:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784619.845028:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750117120 00000100:00100000:2.0:1787784619.845040:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750117120 00000100:00100000:2.0:1787784619.845113:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787784619.845125:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750117120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784619.845459:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750117120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (7708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784619.845468:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787784619.860336:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750117120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.860430:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750117248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.860534:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.860595:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784619.860659:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750117248 00000100:00100000:1.0:1787784619.860667:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750117248 00000100:00100000:1.0:1787784619.860736:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787784619.860747:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750117248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784619.860954:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750117248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784619.860963:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787784619.861132:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750117248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784619.863350:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13785:1874627750117376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784619.863461:0:13785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784619.863523:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784619.863823:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750117376 00000100:00100000:3.0:1787784619.863833:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750117376 00000100:00100000:3.0:1787784619.863901:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787784619.863913:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:13785:x1874627750117376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784619.864128:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:13785:x1874627750117376:12345-0@lo:502:llog_process_th.0 Request processed in 218us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.864137:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787784619.864379:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13785:1874627750117376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784619.864418:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784619.864432:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784619.864435:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787784619.864442:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951efedf000 00000020:00000080:1.0:1787784619.864445:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787784619.864552:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13785:1874627750117504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784619.864598:0:13785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784619.864627:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784619.864684:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750117504 00000100:00100000:3.0:1787784619.864688:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750117504 00000100:00100000:3.0:1787784619.864720:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787784619.864728:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:13785:x1874627750117504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784619.864830:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:13785:x1874627750117504:12345-0@lo:502:llog_process_th.0 Request processed in 100us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.864860:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787784619.866386:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13785:1874627750117504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784619.866440:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784619.866461:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784619.866464:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787784619.866468:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787784619.866706:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787784619.866747:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784619.866761:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cff5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.866793:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cff5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784619.866806:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784619.866809:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951cfe95800 from 7 10000000:01000000:3.0:1787784619.866812:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784619.866862:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.866871:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.866881:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.866905:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750117632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.869125:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.870426:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750117632 00000100:00100000:3.0:1787784619.870441:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750117632 00000100:00100000:3.0:1787784619.870504:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787784619.870516:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750117632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784619.870540:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784619.870564:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3713400/0x88ace7295d9d003 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9cffc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.870618:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3713400/0x88ace7295d9d003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9cffc expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.870631:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3713400/0x88ace7295d9d003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cffc expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.870643:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713400, rc 0) 00000100:00100000:3.0:1787784619.870703:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750117632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.870711:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787784619.870785:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784619.870815:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750117632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784619.870834:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d003 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.870845:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9d003 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784619.871907:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784619.876113:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750117760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.876226:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.876304:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728010240 00000100:00100000:3.0:1787784619.876313:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728010240 00000100:00100000:3.0:1787784619.876369:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750117760 00000100:00100000:3.0:1787784619.876373:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750117760 00000100:00100000:3.0:1787784619.876394:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 353 00000100:00100000:3.0:1787784619.876404:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+11:6181:x1874627728010240:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784619.876444:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784619.876467:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3713000/0x88ace7295d9d00a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7299e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.876503:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3713000/0x88ace7295d9d00a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7299e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.876516:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3713000/0x88ace7295d9d00a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7299e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.876528:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713000, rc 0) 00000100:00100000:3.0:1787784619.876597:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728010240:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 193us (4697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.876605:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 353 00000100:00100000:3.0:1787784619.876636:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787784619.876642:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750117760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.876801:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750117760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.876810:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787784619.877374:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784619.877402:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750117760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.877453:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750117888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.877509:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.877531:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750117888 00000100:00100000:3.0:1787784619.877535:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750117888 00000100:00100000:3.0:1787784619.877562:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787784619.877577:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750117888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.877661:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750117888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.877668:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787784619.877701:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784619.877712:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750117888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784619.881166:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784619.881373:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728010368 00000100:00100000:3.0:1787784619.881386:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728010368 00000100:00100000:3.0:1787784619.881458:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 356 00000100:00100000:3.0:1787784619.881471:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728010368:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.881672:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728010368:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 203us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.881682:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 356 00000100:00100000:0.0:1787784619.884225:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ae940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13786:1874627750118016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784619.884360:0:13786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784619.884420:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750118016 00000100:00100000:0.0:1787784619.884429:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750118016 00000100:00100000:0.0:1787784619.884488:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787784619.884500:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:13786:x1874627750118016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784619.884659:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:13786:x1874627750118016:12345-0@lo:502:llog_process_th.0 Request processed in 160us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784619.884669:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787784619.884732:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8939900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784619.884760:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ae940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13786:1874627750118016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787784619.884817:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784619.884836:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784619.884839:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787784619.884857:0:13786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951cfe95800 00000020:00000080:0.0:1787784619.884860:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787784619.885337:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784619.885368:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728010496 00000100:00100000:3.0:1787784619.885374:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728010496 00000100:00100000:3.0:1787784619.885410:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 358 00000100:00100000:3.0:1787784619.885419:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728010496:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.885526:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728010496:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 107us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.885533:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 358 00000100:00100000:0.0:1787784619.886585:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ae940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13786:1874627750118144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784619.886651:0:13786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784619.886683:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8939900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784619.888219:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750118144 00000100:00100000:3.0:1787784619.888237:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750118144 00000100:00100000:3.0:1787784619.888307:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787784619.888319:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:13786:x1874627750118144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784619.888518:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+23:13786:x1874627750118144:12345-0@lo:502:llog_process_th.0 Request processed in 201us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.888527:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787784619.889094:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ae940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13786:1874627750118144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787784619.889153:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784619.889164:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784619.889167:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787784619.889171:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787784619.892188:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787784619.892240:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784619.892257:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d003 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.892274:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d003 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784619.892288:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784619.892292:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951d08ed800 from 7 10000000:01000000:3.0:1787784619.892294:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784619.892342:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.892350:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.892363:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.892390:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750118272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.892470:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.892515:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750118272 00000100:00100000:3.0:1787784619.892522:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750118272 00000100:00100000:3.0:1787784619.892570:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787784619.892580:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750118272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784619.892608:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784619.892622:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3713200/0x88ace7295d9d018 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9d011 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.892649:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3713200/0x88ace7295d9d018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9d011 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.892661:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3713200/0x88ace7295d9d018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9d011 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.892670:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713200, rc 0) 00000100:00100000:3.0:1787784619.892702:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750118272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.892708:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787784619.892755:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784619.892801:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750118272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784619.892816:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d018 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.892826:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9d018 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.892904:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750118400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784619.893196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784619.893230:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728010624 00000100:00100000:2.0:1787784619.893235:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728010624 00000100:00100000:2.0:1787784619.893274:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 361 00000100:00100000:2.0:1787784619.893281:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+12:10795:x1874627728010624:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787784619.894266:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+12:10795:x1874627728010624:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 976us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784619.894278:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 361 00000100:00100000:3.0:1787784619.895254:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.895319:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750118400 00000100:00100000:3.0:1787784619.895328:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750118400 00000100:00100000:3.0:1787784619.895394:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1787784619.895405:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750118400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.895663:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750118400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.895673:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000040:00080000:2.0:1787784619.896740:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787784619.897188:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784619.897222:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750118400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.897292:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750118528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.897361:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.897395:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750118528 00000100:00100000:3.0:1787784619.897401:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750118528 00000100:00100000:3.0:1787784619.897442:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1787784619.897452:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750118528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.900670:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750118528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3203us (3294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.900688:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1787784619.900763:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784619.900810:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750118528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784619.907218:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784619.907284:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728010752 00000100:00100000:3.0:1787784619.907298:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728010752 00000100:00100000:3.0:1787784619.907365:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 364 00000100:00100000:3.0:1787784619.907377:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+12:10795:x1874627728010752:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784619.907599:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+12:10795:x1874627728010752:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 224us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.907610:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 364 00000100:00100000:1.0:1787784619.908959:0:13791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13791:1874627750118656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784619.909050:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784619.909096:0:13791:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784619.909162:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750118656 00000100:00100000:3.0:1787784619.909171:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750118656 00000100:00100000:3.0:1787784619.909230:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1787784619.909243:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:13791:x1874627750118656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784619.909396:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:13791:x1874627750118656:12345-0@lo:502:llog_process_th.0 Request processed in 155us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.909404:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787784619.909559:0:13791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13791:1874627750118656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784619.909598:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784619.909611:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784619.909614:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787784619.909624:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951d08ed800 00000020:00000080:1.0:1787784619.909628:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787784619.909743:0:13791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13791:1874627750118784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784619.909822:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784619.909860:0:13791:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784619.910319:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750118784 00000100:00100000:3.0:1787784619.910329:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750118784 00000100:00100000:3.0:1787784619.910384:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1787784619.910397:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:13791:x1874627750118784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784619.910522:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:13791:x1874627750118784:12345-0@lo:502:llog_process_th.0 Request processed in 128us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.910531:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787784619.911050:0:13791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13791:1874627750118784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784619.911085:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784619.911094:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784619.911097:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787784619.911102:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787784619.911342:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787784619.911373:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784619.911390:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d018 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.911404:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d018 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.912581:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784619.912878:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728010880 00000100:00100000:1.0:1787784619.912888:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728010880 00000100:00100000:1.0:1787784619.912985:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 367 00000100:00100000:1.0:1787784619.912998:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728010880:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784619.913019:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784619.913043:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df602400/0x88ace7295d9d01f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e729a5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784619.913094:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602400/0x88ace7295d9d01f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729a5 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784619.913108:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df602400/0x88ace7295d9d01f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729a5 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784619.913121:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602400, rc 0) 00000100:00100000:1.0:1787784619.913209:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728010880:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 212us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784619.913216:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 367 00000100:00100000:0.0:1787784619.919240:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784619.919415:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728011008 00000100:00100000:0.0:1787784619.919428:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728011008 00000100:00100000:0.0:1787784619.919494:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 368 00000100:00100000:0.0:1787784619.919508:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728011008:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784619.919717:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728011008:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 212us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784619.919726:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 368 00000100:00100000:3.0:1787784619.925305:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784619.925404:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728011136 00000100:00100000:1.0:1787784619.925417:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728011136 00000100:00100000:1.0:1787784619.925496:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 369 00000100:00100000:1.0:1787784619.925509:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728011136:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784619.925698:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728011136:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 190us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784619.925708:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 369 00000100:00100000:3.0:1787784619.931218:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784619.931279:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728011264 00000100:00100000:3.0:1787784619.931292:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728011264 00000100:00100000:3.0:1787784619.931360:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 370 00000100:00100000:3.0:1787784619.931380:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:10798:x1874627728011264:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784619.931568:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:10798:x1874627728011264:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 190us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.931577:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 370 00000100:00100000:2.0:1787784619.935182:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784619.935283:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728011392 00000100:00100000:3.0:1787784619.935297:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728011392 00000100:00100000:3.0:1787784619.935369:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 371 00000100:00100000:3.0:1787784619.935382:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:10798:x1874627728011392:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784619.935582:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:10798:x1874627728011392:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 202us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784619.935593:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 371 00000020:00000080:0.0:1787784619.936401:0:13789:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd84a8ab80 20000000:00000080:0.0:1787784619.936423:0:13789:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8950c3777800 uarg=0000000000000000 20000000:01000000:0.0:1787784619.936479:0:13789:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787784619.936487:0:13789:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787784619.936494:0:13789:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1787784619.942325:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1787784619.943286:0:13789:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1787784619.945047:0:13789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1787784619.945095:0:13789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1787784619.945114:0:13789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1787784619.945133:0:13789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787784619.945160:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945183:0:13789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951df603400/0x88ace7295d9cfe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cfe0 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945192:0:13789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8950c3712800/0x88ace7295d9cff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cfee expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945199:0:13789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8950c3713400/0x88ace7295d9d003 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9cffc expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945223:0:13789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8950c3713000/0x88ace7295d9d00a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7299e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945230:0:13789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8950c3713200/0x88ace7295d9d018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9d011 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945237:0:13789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951df602400/0x88ace7295d9d01f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729a5 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945245:0:13789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945300:0:13789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951df602400/0x88ace7295d9d01f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729a5 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945321:0:13789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951df602400/0x88ace7295d9d01f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729a5 expref: 12 pid: 6516 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.945341:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13789:1874627750118912:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784619.945627:0:13789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8950c3713200/0x88ace7295d9d018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9d011 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945636:0:13789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8950c3713200/0x88ace7295d9d018 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9d011 expref: 23 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.945647:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13789:1874627750119040:0@lo:104: 00000100:00100000:3.0:1787784619.945702:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784619.945753:0:13789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8950c3713000/0x88ace7295d9d00a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7299e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945796:0:13789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8950c3713000/0x88ace7295d9d00a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7299e expref: 12 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.945807:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3576940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13789:1874627750119168:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784619.945845:0:13789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8950c3713400/0x88ace7295d9d003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cffc expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945865:0:13789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8950c3713400/0x88ace7295d9d003 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cffc expref: 23 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.945873:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3574f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13789:1874627750119296:0@lo:104: 00000100:00100000:3.0:1787784619.945901:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784619.945927:0:13789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8950c3712800/0x88ace7295d9cff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cfee expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945936:0:13789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8950c3712800/0x88ace7295d9cff5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cfee expref: 23 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.945944:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2664f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13789:1874627750119424:0@lo:104: 00000100:00100000:3.0:1787784619.945967:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784619.945984:0:13789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951df603400/0x88ace7295d9cfe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9cfe0 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.945992:0:13789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8951df603400/0x88ace7295d9cfe7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9cfe0 expref: 23 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.946000:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13789:1874627750119552:0@lo:104: 00000100:00100000:3.0:1787784619.946023:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784619.946042:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c11ca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784619.946139:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787784619.946160:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750119040 00000100:00100000:2.0:1787784619.946170:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750119040 00000100:00100000:2.0:1787784619.946221:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750119296 00000100:00100000:2.0:1787784619.946225:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750119296 00000100:00100000:2.0:1787784619.946236:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750119424 00000100:00100000:2.0:1787784619.946239:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750119424 00000100:00100000:2.0:1787784619.946248:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750119552 00000100:00100000:2.0:1787784619.946257:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750119552 00000100:00100000:2.0:1787784619.946277:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787784619.946288:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+6:13789:x1874627750119040:12345-0@lo:104: 00010000:00010000:2.0:1787784619.946304:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9d018 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946379:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784619.946386:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+6:13789:x1874627750119040:12345-0@lo:104: Request processed in 100us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784619.946394:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787784619.946414:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787784619.946420:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+5:13789:x1874627750119296:12345-0@lo:104: 00010000:00010000:2.0:1787784619.946428:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9d003 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946464:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787784619.946469:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+5:13789:x1874627750119296:12345-0@lo:104: Request processed in 49us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784619.946475:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787784619.946486:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787784619.946491:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:13789:x1874627750119424:12345-0@lo:104: 00010000:00010000:2.0:1787784619.946499:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cff5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946530:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787784619.946535:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+4:13789:x1874627750119424:12345-0@lo:104: Request processed in 44us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784619.946541:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787784619.946558:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787784619.946563:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3652450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:13789:x1874627750119552:12345-0@lo:104: 00010000:00010000:2.0:1787784619.946571:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cfe7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946597:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787784619.946602:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3652450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee96db03-39cf-4d18-a974-880a628ded6e+3:13789:x1874627750119552:12345-0@lo:104: Request processed in 39us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784619.946607:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1787784619.946648:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787784619.946656:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9d018 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946664:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712600 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784619.946669:0:10397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9d018 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946678:0:10397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9d018 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784619.946687:0:10397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9d018 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784619.946694:0:10397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787784619.946728:0:10397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9d018 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946736:0:10397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784619.946761:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9d018 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946809:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c3712600/0x88ace7295d9d011 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9d018 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946824:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787784619.946827:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9d003 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946834:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712a00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784619.946837:0:10397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9d003 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946844:0:10397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9d003 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784619.946863:0:10397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9d003 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784619.946868:0:10397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787784619.946885:0:10397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9d003 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946891:0:10397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784619.946897:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9d003 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946904:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c3712a00/0x88ace7295d9cffc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9d003 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946913:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784619.946923:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cff5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946930:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713c00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784619.946933:0:10397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cff5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946939:0:10397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cff5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784619.946945:0:10397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cff5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784619.946950:0:10397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787784619.946964:0:10397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cff5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946970:0:10397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784619.946989:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cff5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.946997:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c3713c00/0x88ace7295d9cfee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cff5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947006:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784619.947009:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9cfe7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947015:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712200 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784619.947018:0:10397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9cfe7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947036:0:10397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9cfe7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784619.947042:0:10397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9cfe7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784619.947046:0:10397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787784619.947060:0:10397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cfe7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947066:0:10397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784619.947072:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cfe7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947079:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9cfe0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9cfe7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947093:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784619.947095:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784619.947097:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784619.947104:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784619.947111:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784619.947126:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750119680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784619.947170:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784619.947201:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784619.947208:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750119808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784619.947230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784619.947259:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750119936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784619.947293:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784619.947313:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784619.947319:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750120064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784619.947343:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784619.947378:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750119680 00000100:00100000:2.0:1787784619.947384:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750119680 00010000:00010000:2.0:1787784619.947410:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8950c3713200/0x88ace7295d9d018 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9d011 expref: 24 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784619.947429:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750119808 00000100:00100000:2.0:1787784619.947431:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750119808 00010000:00010000:2.0:1787784619.947461:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8950c3713400/0x88ace7295d9d003 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cffc expref: 25 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784619.947472:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750119936 00000100:00100000:2.0:1787784619.947474:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750119936 00010000:00010000:2.0:1787784619.947483:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8950c3712800/0x88ace7295d9cff5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cfee expref: 26 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784619.947493:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750120064 00000100:00100000:2.0:1787784619.947495:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750120064 00010000:00010000:2.0:1787784619.947505:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951df603400/0x88ace7295d9cfe7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cfe0 expref: 27 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784619.947517:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787784619.947524:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfebf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+27:3646:x1874627750119680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784619.947537:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784619.947542:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8950c3713200/0x88ace7295d9d018 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9d011 expref: 27 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947552:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8950c3713200/0x88ace7295d9d018 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9d011 expref: 27 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947579:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784619.947611:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfebf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+27:3646:x1874627750119680:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784619.947618:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787784619.947660:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787784619.947666:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+26:3646:x1874627750119808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784619.947674:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784619.947678:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8950c3713400/0x88ace7295d9d003 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cffc expref: 26 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947686:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8950c3713400/0x88ace7295d9d003 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cffc expref: 26 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947696:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784619.947715:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+26:3646:x1874627750119808:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784619.947721:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787784619.947734:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787784619.947739:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+25:3644:x1874627750119936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784619.947746:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784619.947751:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8950c3712800/0x88ace7295d9cff5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cfee expref: 25 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947759:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8950c3712800/0x88ace7295d9cff5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cfee expref: 25 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947791:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784619.947825:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+25:3644:x1874627750119936:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784619.947832:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787784619.947843:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787784619.947862:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750120064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784619.947870:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784619.947875:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951df603400/0x88ace7295d9cfe7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9cfe0 expref: 24 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947882:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951df603400/0x88ace7295d9cfe7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9cfe0 expref: 24 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.947892:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784619.947913:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750120064:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784619.947919:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787784619.947974:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750120064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784619.947985:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750119936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784619.948013:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750119808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784619.948021:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750119680:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784619.949974:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3713200/0x88ace7295d9d018 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9d011 expref: 23 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.949998:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13789:1874627750119040:0@lo:104: 00010000:00010000:3.0:1787784619.950015:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3713400/0x88ace7295d9d003 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cffc expref: 22 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.950023:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3574f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13789:1874627750119296:0@lo:104: 00010000:00010000:3.0:1787784619.950035:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3712800/0x88ace7295d9cff5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cfee expref: 21 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.950043:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2664f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13789:1874627750119424:0@lo:104: 00010000:00010000:3.0:1787784619.950054:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df603400/0x88ace7295d9cfe7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9cfe0 expref: 20 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.950062:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13789:1874627750119552:0@lo:104: 00000100:00100000:2.0:1787784619.958229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784619.958271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784619.958312:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728011520 00000100:00100000:2.0:1787784619.958325:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728011520 00010000:00010000:2.0:1787784619.958376:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951df602400/0x88ace7295d9d01f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729a5 expref: 13 pid: 6516 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784619.958429:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728011648 00000100:00100000:2.0:1787784619.958432:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728011648 00010000:00010000:2.0:1787784619.958443:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8950c3713000/0x88ace7295d9d00a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7299e expref: 14 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784619.958461:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:2.0:1787784619.958469:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65cfdd26-2f8c-42a9-9063-79ee47420602+14:2406:x1874627728011520:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784619.958487:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784619.958493:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951df602400/0x88ace7295d9d01f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729a5 expref: 14 pid: 6516 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.958520:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951df602400/0x88ace7295d9d01f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729a5 expref: 14 pid: 6516 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.958549:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784619.958619:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65cfdd26-2f8c-42a9-9063-79ee47420602+14:2406:x1874627728011520:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 149us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784619.958628:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:2.0:1787784619.958649:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:2.0:1787784619.958655:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2405:x1874627728011648:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784619.958664:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784619.958668:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8950c3713000/0x88ace7295d9d00a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7299e expref: 13 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.958678:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8950c3713000/0x88ace7295d9d00a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7299e expref: 13 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.958709:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.958719:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.958738:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.958745:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.958752:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.958759:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.958798:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784619.958804:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.958812:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.958821:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784619.958833:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784619.958865:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2405:x1874627728011648:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 210us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784619.958880:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00010000:00010000:3.0:1787784619.959203:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df602400/0x88ace7295d9d01f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729a5 expref: 12 pid: 6516 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.959221:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13789:1874627750118912:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784619.959236:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3713000/0x88ace7295d9d00a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7299e expref: 11 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784619.959246:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3576940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13789:1874627750119168:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784619.959287:0:13789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.959300:0:13789:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.959314:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784619.959319:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3713a00/0x88ace7295d9d026 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784620.550161:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784620.939475:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787784621.318921:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784621.318933:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951f53b5800 from 10 10000000:01000000:3.0:1787784621.318941:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784621.319012:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784621.319027:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784621.319042:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784621.319078:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750120192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784621.319182:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784621.319376:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750120192 00000100:00100000:1.0:1787784621.319388:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750120192 00000100:00100000:1.0:1787784621.319472:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787784621.319485:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+20:6518:x1874627750120192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784621.319504:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784621.319521:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df603000/0x88ace7295d9d034 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9d02d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784621.319555:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603000/0x88ace7295d9d034 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9d02d expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784621.319591:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df603000/0x88ace7295d9d034 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9d02d expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784621.319602:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603000, rc 0) 00000100:00100000:1.0:1787784621.322216:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750120192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2720us (3021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784621.322233:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787784621.326071:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c11ca6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784621.326138:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750120192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784621.326630:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784621.326661:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784621.326810:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750120320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784621.326930:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784621.327464:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750120320 00000100:00100000:2.0:1787784621.327474:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750120320 00000100:00100000:2.0:1787784621.327544:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1787784621.327557:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750120320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784621.327724:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750120320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.327732:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787784621.327992:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c11ca6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784621.328017:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750120320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784621.328062:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750120448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784621.328118:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784621.328854:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750120448 00000100:00100000:1.0:1787784621.328864:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750120448 00000100:00100000:1.0:1787784621.328923:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787784621.328935:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750120448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784621.331153:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750120448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2205us (3019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784621.331171:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1787784621.332420:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c11ca6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784621.332473:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750120448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784621.341422:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13806:1874627750120576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784621.341560:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784621.341723:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c11ca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784621.344895:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750120576 00000100:00100000:0.0:1787784621.344916:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750120576 00000100:00100000:0.0:1787784621.345009:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787784621.345039:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:13806:x1874627750120576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784621.345337:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784621.345546:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784621.345582:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784621.345610:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784621.345634:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784621.345664:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784621.345696:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728012160 00000100:00100000:1.0:1787784621.345702:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728012160 00000100:00100000:1.0:1787784621.345759:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:1.0:1787784621.345798:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728012160:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784621.345886:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728012160:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 118us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784621.345904:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:13806:x1874627750120576:12345-0@lo:502:llog_process_th.0 Request processed in 866us (4342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784621.345917:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1787784621.345922:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:1.0:1787784621.345951:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728012032 00000100:00100000:1.0:1787784621.345955:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728012032 00000100:00100000:0.0:1787784621.345965:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728011776 00000100:00100000:0.0:1787784621.345971:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728011776 00000100:00100000:1.0:1787784621.345993:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728012288 00000100:00100000:3.0:1787784621.346040:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728011904 00000100:00100000:3.0:1787784621.346045:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728011904 00000100:00100000:3.0:1787784621.346070:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728012416 00000100:00100000:3.0:1787784621.346073:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728012416 00000100:00100000:3.0:1787784621.346090:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 242 00000100:00100000:3.0:1787784621.346098:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728012032:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784621.346133:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728012032:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 37us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784621.346140:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 242 00000100:00100000:3.0:1787784621.346152:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 243 00000100:00100000:3.0:1787784621.346159:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728011904:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784621.346185:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728011904:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 27us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784621.346190:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 243 00000100:00100000:3.0:1787784621.346211:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 244 00000100:00100000:3.0:1787784621.346218:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728012416:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784621.346270:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728012288 00000100:00100000:1.0:1787784621.346295:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 245 00000100:00100000:1.0:1787784621.346301:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728012288:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784621.346328:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728012288:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 27us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784621.346334:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 245 00000100:00080000:1.0:1787784621.346353:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784621.346358:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784621.346361:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784621.346598:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26670c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13806:1874627750120576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784621.346646:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784621.346658:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784621.346661:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787784621.346669:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951f53b5800 00000020:00000080:1.0:1787784621.346672:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787784621.348794:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f1a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13806:1874627750120704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784621.353422:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728012416:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 39us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784621.353450:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 244 00000100:00100000:1.0:1787784621.356066:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784621.362672:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784621.367633:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750120704 00000100:00100000:2.0:1787784621.367653:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750120704 00000100:00100000:2.0:1787784621.367735:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 376 00000100:00100000:2.0:1787784621.367747:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+11:2408:x1874627728011776:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784621.367875:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+11:2408:x1874627728011776:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 130us (22541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.367883:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 376 00000100:00100000:2.0:1787784621.367917:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1787784621.367923:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:13806:x1874627750120704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784621.368086:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+21:13806:x1874627750120704:12345-0@lo:502:llog_process_th.0 Request processed in 162us (12032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.368093:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1787784621.368683:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f1a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13806:1874627750120704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784621.368729:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784621.368744:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784621.368747:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787784621.368752:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787784621.370479:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:0.0:1787784621.370528:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787784621.370545:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784621.370561:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784621.370576:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787784621.370580:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951efedf000 from 10 10000000:01000000:0.0:1787784621.370583:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784621.370713:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784621.370724:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784621.370738:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784621.370811:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ae940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750120832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784621.370915:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784621.370965:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8939a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784621.370992:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750120832 00000100:00100000:0.0:1787784621.371017:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750120832 00000100:00100000:0.0:1787784621.371078:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787784621.371088:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+21:6518:x1874627750120832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784621.371105:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784621.371122:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1628e00/0x88ace7295d9d042 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9d03b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784621.371724:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1628e00/0x88ace7295d9d042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9d03b expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784621.371742:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1628e00/0x88ace7295d9d042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9d03b expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784621.371753:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628e00, rc 0) 00000100:00100000:0.0:1787784621.371869:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750120832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 781us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784621.377315:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ae940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750120832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784621.377357:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784621.377384:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784621.379216:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787784621.379389:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750120960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784621.379566:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784621.379628:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33553c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784621.379723:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750120960 00000100:00100000:2.0:1787784621.379733:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750120960 00000100:00100000:2.0:1787784621.379813:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1787784621.379825:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750120960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784621.380007:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750120960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.380015:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1787784621.380126:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750120960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784621.380179:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750121088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784621.380232:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784621.380263:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33553c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784621.380597:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750121088 00000100:00100000:2.0:1787784621.380603:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750121088 00000100:00100000:2.0:1787784621.380638:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787784621.380646:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750121088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784621.380747:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750121088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.380755:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1787784621.381004:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750121088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784621.382867:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787784621.393742:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13810:1874627750121216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784621.393928:0:13810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784621.394340:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8939540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784621.395081:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750121216 00000100:00100000:2.0:1787784621.395093:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750121216 00000100:00100000:3.0:1787784621.395275:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1787784621.395289:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:13810:x1874627750121216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784621.395486:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:13810:x1874627750121216:12345-0@lo:502:llog_process_th.0 Request processed in 201us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784621.395604:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13810:1874627750121216:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787784621.395650:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784621.395664:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784621.395667:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787784621.395675:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951efedf000 00000020:00000080:0.0:1787784621.395678:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787784621.395788:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13810:1874627750121344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784621.395851:0:13810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784621.395903:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1787784621.396054:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750121344 00000100:00100000:3.0:1787784621.396059:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750121344 00000100:00100000:3.0:1787784621.396081:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787784621.396087:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:13810:x1874627750121344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784621.396163:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:13810:x1874627750121344:12345-0@lo:502:llog_process_th.0 Request processed in 74us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784621.396170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1787784621.396328:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8939540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784621.396342:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13810:1874627750121344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787784621.396365:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784621.396371:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784621.396372:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787784621.396376:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787784621.396745:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1787784621.397076:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784621.397091:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784621.397102:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784621.397178:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784621.397182:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951cfe95800 from 10 10000000:01000000:3.0:1787784621.397186:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784621.397223:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784621.397232:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784621.397243:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784621.397269:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2664f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750121472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784621.397319:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784621.397393:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784621.397441:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750121472 00000100:00100000:2.0:1787784621.397453:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750121472 00000100:00100000:3.0:1787784621.397663:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1787784621.397674:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+22:6518:x1874627750121472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784621.397688:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784621.397703:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3712800/0x88ace7295d9d050 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9d049 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784621.397733:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3712800/0x88ace7295d9d050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9d049 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784621.397746:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3712800/0x88ace7295d9d050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9d049 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784621.397756:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712800, rc 0) 00000100:00100000:3.0:1787784621.397845:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750121472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784621.397852:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1787784621.397938:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2664f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750121472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784621.397955:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784621.397963:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784621.398034:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750121600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784621.398066:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784621.398169:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784621.398214:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750121600 00000100:00100000:0.0:1787784621.398220:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750121600 00000100:00100000:0.0:1787784621.398245:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1787784621.398252:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfeea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750121600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784621.398480:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfeea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750121600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784621.398498:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1787784621.398667:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750121600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784621.398867:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750121728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784621.398919:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784621.398979:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784621.399013:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750121728 00000100:00100000:0.0:1787784621.399018:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750121728 00000100:00100000:0.0:1787784621.399087:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1787784621.399096:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfeeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750121728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784621.399239:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfeeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750121728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784621.399246:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1787784621.399322:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2667c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750121728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784621.399729:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13811:1874627750121856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784621.399810:0:13811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784621.399831:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33b5780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784621.399897:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750121856 00000100:00100000:3.0:1787784621.399903:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750121856 00000100:00100000:3.0:1787784621.399942:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1787784621.399951:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:13811:x1874627750121856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784621.400059:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:13811:x1874627750121856:12345-0@lo:502:llog_process_th.0 Request processed in 108us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784621.400066:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1787784621.400142:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13811:1874627750121856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784621.400168:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784621.400179:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784621.400182:0:13811:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787784621.400190:0:13811:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951cfe95800 00000020:00000080:2.0:1787784621.400193:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787784621.400276:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13811:1874627750121984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784621.400312:0:13811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784621.400345:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33b5780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784621.400385:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750121984 00000100:00100000:3.0:1787784621.400390:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750121984 00000100:00100000:3.0:1787784621.400420:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1787784621.400427:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:13811:x1874627750121984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784621.400619:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:13811:x1874627750121984:12345-0@lo:502:llog_process_th.0 Request processed in 62us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784621.400627:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1787784621.400697:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13811:1874627750121984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784621.400720:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784621.400724:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784621.400726:0:13811:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787784621.400730:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787784621.400959:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1787784621.400981:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784621.400992:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784621.401004:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784621.401016:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784621.401020:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951d08ed800 from 10 10000000:01000000:3.0:1787784621.401023:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784621.401054:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784621.401062:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784621.401072:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784621.401098:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2664780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750122112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784621.401131:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784621.401158:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784621.401198:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750122112 00000100:00100000:2.0:1787784621.401202:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750122112 00000100:00100000:2.0:1787784621.401234:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787784621.401242:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+23:6518:x1874627750122112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784621.401251:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784621.401266:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c13fec00/0x88ace7295d9d05e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9d057 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784621.401292:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c13fec00/0x88ace7295d9d05e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9d057 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784621.401303:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c13fec00/0x88ace7295d9d05e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9d057 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784621.401311:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c13fec00, rc 0) 00000100:00100000:2.0:1787784621.401343:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750122112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.401349:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1787784621.401410:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2664780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750122112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784621.401424:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784621.401433:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784621.401487:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2664780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750122240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784621.401587:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784621.401607:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784621.401649:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750122240 00000100:00100000:2.0:1787784621.401654:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750122240 00000100:00100000:2.0:1787784621.401683:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1787784621.401690:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750122240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784621.401824:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750122240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.401852:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1787784621.401930:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2664780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750122240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784621.401963:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2664780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750122368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784621.402001:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784621.402019:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784621.402580:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750122368 00000100:00100000:2.0:1787784621.402586:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750122368 00000100:00100000:2.0:1787784621.402653:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787784621.402662:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750122368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784621.402755:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:6518:x1874627750122368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.402762:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787784621.405315:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2664780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee96db03-39cf-4d18-a974-880a628ded6e:6518:1874627750122368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784621.413402:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13813:1874627750122496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784621.413584:0:13813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784621.413634:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33b5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784621.413721:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750122496 00000100:00100000:0.0:1787784621.413730:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750122496 00000100:00100000:0.0:1787784621.413805:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787784621.413815:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:13813:x1874627750122496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784621.413976:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:13813:x1874627750122496:12345-0@lo:502:llog_process_th.0 Request processed in 161us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784621.413984:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1787784621.414172:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13813:1874627750122496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784621.414209:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784621.414222:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784621.414225:0:13813:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787784621.414232:0:13813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951d08ed800 00000020:00000080:3.0:1787784621.414236:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787784621.414338:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2665680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13813:1874627750122624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784621.414386:0:13813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784621.414970:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c24a5480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784621.417652:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750122624 00000100:00100000:2.0:1787784621.417674:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750122624 00000100:00100000:2.0:1787784621.417902:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787784621.417920:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:13813:x1874627750122624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784621.418227:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:13813:x1874627750122624:12345-0@lo:502:llog_process_th.0 Request processed in 311us (3838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.418236:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787784621.418338:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2665680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee96db03-39cf-4d18-a974-880a628ded6e:13813:1874627750122624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784621.418384:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784621.418394:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784621.418397:0:13813:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787784621.418403:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787784621.420809:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1787784621.420876:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784621.420893:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784621.420909:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784621.575225:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784621.789732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784621.789978:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728012544 00000100:00100000:2.0:1787784621.789992:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728012544 00000100:00100000:2.0:1787784621.790096:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 393 00000100:00100000:2.0:1787784621.790111:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+11:6181:x1874627728012544:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784621.790135:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784621.790192:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c13fee00/0x88ace7295d9d065 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e729ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784621.790240:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c13fee00/0x88ace7295d9d065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729ac expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784621.790253:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c13fee00/0x88ace7295d9d065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729ac expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784621.790265:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c13fee00, rc 0) 00000100:00100000:2.0:1787784621.790340:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728012544:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 234us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.790348:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 393 00000100:00100000:3.0:1787784621.792133:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784621.809820:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728012672 00000100:00100000:0.0:1787784621.809851:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728012672 00000100:00100000:2.0:1787784621.811855:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 394 00000100:00100000:2.0:1787784621.811887:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728012672:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784621.812125:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728012672:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 254us (20008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.812134:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 394 00000100:00100000:3.0:1787784621.819188:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784621.819329:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728012800 00000100:00100000:1.0:1787784621.819344:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728012800 00000100:00100000:1.0:1787784621.819407:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 395 00000100:00100000:1.0:1787784621.819420:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728012800:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784621.819632:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728012800:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 214us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784621.819642:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 395 00000100:00100000:3.0:1787784621.829481:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784621.830397:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728012928 00000100:00100000:1.0:1787784621.830413:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728012928 00000100:00100000:1.0:1787784621.832067:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 396 00000100:00100000:1.0:1787784621.832095:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+12:10802:x1874627728012928:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784621.832358:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+12:10802:x1874627728012928:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 274us (2891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784621.832367:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 396 00000100:00100000:3.0:1787784621.837361:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784621.837591:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728013056 00000100:00100000:2.0:1787784621.837604:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728013056 00000100:00100000:2.0:1787784621.840902:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 397 00000100:00100000:2.0:1787784621.843117:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+12:10802:x1874627728013056:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787784621.844432:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+12:10802:x1874627728013056:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 3504us (7076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.844449:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 397 00000100:00100000:3.0:1787784621.851001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784621.851209:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728013184 00000100:00100000:1.0:1787784621.851224:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728013184 00000100:00100000:1.0:1787784621.851307:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 398 00000100:00100000:1.0:1787784621.851318:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+12:6181:x1874627728013184:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784621.851340:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784621.851363:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df603600/0x88ace7295d9d06c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e729b3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784621.851403:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603600/0x88ace7295d9d06c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729b3 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784621.851417:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df603600/0x88ace7295d9d06c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729b3 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784621.851428:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603600, rc 0) 00000100:00100000:1.0:1787784621.851500:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728013184:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 183us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784621.851509:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 398 00000100:00100000:3.0:1787784621.861032:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784621.862954:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728013312 00000100:00100000:2.0:1787784621.863001:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728013312 00000100:00100000:2.0:1787784621.863089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 399 00000100:00100000:2.0:1787784621.863100:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728013312:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784621.863313:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728013312:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 213us (2297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.863323:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 399 00000100:00100000:3.0:1787784621.866380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784621.866608:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728013440 00000100:00100000:0.0:1787784621.866623:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728013440 00000100:00100000:0.0:1787784621.866712:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 400 00000100:00100000:0.0:1787784621.866725:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728013440:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784621.866974:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:6181:x1874627728013440:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 251us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784621.866984:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 400 00000100:00100000:3.0:1787784621.871069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784621.871289:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728013568 00000100:00100000:1.0:1787784621.872360:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728013568 00000100:00100000:1.0:1787784621.872440:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 401 00000100:00100000:1.0:1787784621.872451:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:10805:x1874627728013568:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784621.872671:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:10805:x1874627728013568:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 220us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784621.872690:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 401 00000100:00100000:3.0:1787784621.884708:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784621.885128:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728013696 00000100:00100000:2.0:1787784621.885143:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728013696 00000100:00100000:2.0:1787784621.885240:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 402 00000100:00100000:2.0:1787784621.885253:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:10805:x1874627728013696:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787784621.885478:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:10805:x1874627728013696:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 226us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784621.885497:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 402 00000100:00100000:0.0:1787784622.214130:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784622.214865:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750123008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784622.214978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784622.215963:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750123008 00000100:00100000:1.0:1787784622.215980:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750123008 00000100:00100000:1.0:1787784622.216063:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787784622.216075:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750123008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784622.216125:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787784622.216229:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750123008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784622.216237:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787784622.218301:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2665680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750122880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784622.218405:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784622.218789:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750123008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784622.219713:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750122752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784622.219877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784622.224976:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750122880 00000100:00100000:1.0:1787784622.224999:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750122880 00000100:00080000:2.0:1787784622.225127:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784622.225257:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750122752 00000100:00100000:3.0:1787784622.225263:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750122752 00000100:00100000:3.0:1787784622.225369:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787784622.225382:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750122880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784622.225467:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784622.225688:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787784622.225700:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750122752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784622.225714:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784622.225874:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750122752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (5996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784622.225882:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787784622.225954:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750122752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784622.226247:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750122880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 868us (7842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784622.226255:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1787784622.227052:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784622.227206:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2665680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750122880:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1787784622.407685:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787784622.599412:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784622.726945:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784622.726975:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750123136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784622.727092:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784622.727194:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750123136 00000100:00100000:3.0:1787784622.727204:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750123136 00000100:00100000:3.0:1787784622.727280:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787784622.727292:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2665680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750123136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787784622.727336:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784622.727395:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2665680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750123136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784622.727404:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:3.0:1787784622.727452:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36f03c0 x1874627750123136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784622.727475:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750123136:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787784622.727583:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784622.728156:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750123264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784622.728217:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784622.729171:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750123264 00000100:00100000:1.0:1787784622.729187:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750123264 00000100:00100000:1.0:1787784622.729272:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787784622.729283:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750123264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784622.729313:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784622.729388:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750123264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784622.729396:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1787784622.729542:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36f2580 x1874627750123264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784622.729589:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750123264:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787784622.729621:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784622.731252:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750123392:0@lo:400:kworker.0 00000100:00100000:3.0:1787784622.731343:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784622.731448:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750123392 00000100:00100000:1.0:1787784622.731457:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750123392 00000100:00100000:1.0:1787784622.731521:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1787784622.731533:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3647:x1874627750123392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784622.732153:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750123776:0@lo:400:kworker.0 00000100:00100000:2.0:1787784622.732206:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784622.732263:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750123776 00000100:00100000:2.0:1787784622.732269:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750123776 00000100:00100000:2.0:1787784622.732315:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787784622.732323:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750123776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784622.732368:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750123776:12345-0@lo:400:kworker.0 Request processed in 45us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784622.732375:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787784622.732427:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750123776:0@lo:400:kworker.0 00000100:00100000:2.0:1787784622.732467:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750123648:0@lo:400:kworker.0 00000100:00100000:2.0:1787784622.732501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784622.732525:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784622.732531:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750123520:0@lo:400:kworker.0 00000100:00100000:2.0:1787784622.732557:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784622.732585:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750123520 00000100:00100000:2.0:1787784622.732588:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750123520 00000100:00100000:2.0:1787784622.732615:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787784622.732622:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750123520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784622.732664:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750123520:12345-0@lo:400:kworker.0 Request processed in 41us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784622.732670:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787784622.732721:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750123520:0@lo:400:kworker.0 00000100:00100000:2.0:1787784622.732756:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750123648 00000100:00100000:2.0:1787784622.732760:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750123648 00000100:00100000:2.0:1787784622.732819:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787784622.732837:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750123648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784622.732879:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750123648:12345-0@lo:400:kworker.0 Request processed in 43us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784622.732885:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787784622.732914:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750123648:0@lo:400:kworker.0 00000100:00100000:1.0:1787784622.739550:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3647:x1874627750123392:12345-0@lo:400:kworker.0 Request processed in 8002us (8189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784622.739571:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1787784622.741578:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750124032:0@lo:400:kworker.0 00000100:00100000:1.0:1787784622.741679:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784622.741743:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784622.741750:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750124160:0@lo:400:kworker.0 00000100:00100000:1.0:1787784622.741798:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784622.741857:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750124032 00000100:00100000:1.0:1787784622.741867:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750124032 00000100:00100000:1.0:1787784622.741930:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750124160 00000100:00100000:1.0:1787784622.741933:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750124160 00000100:00100000:1.0:1787784622.741962:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787784622.741974:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750124032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784622.742165:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750124032:12345-0@lo:400:kworker.0 Request processed in 193us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784622.742174:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787784622.742192:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787784622.742199:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750124160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784622.742229:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750124160:12345-0@lo:400:kworker.0 Request processed in 31us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784622.742235:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787784622.742285:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750124160:0@lo:400:kworker.0 00010000:00080000:1.0:1787784622.742301:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12af840 x1874627750124032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784622.742313:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750124032:0@lo:400:kworker.0 00000100:00080000:2.0:1787784622.742426:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784622.742432:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784622.742448:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750124288:0@lo:400:kworker.0 00000100:00100000:2.0:1787784622.742485:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784622.742518:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784622.742525:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750123904:0@lo:400:kworker.0 00000100:00100000:2.0:1787784622.742548:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784622.742576:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750124288 00000100:00100000:2.0:1787784622.742580:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750124288 00000100:00100000:2.0:1787784622.742609:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750123904 00000100:00100000:2.0:1787784622.742612:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750123904 00000100:00100000:2.0:1787784622.742631:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787784622.742638:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750124288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784622.742671:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750124288:12345-0@lo:400:kworker.0 Request processed in 34us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784622.742678:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787784622.742691:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787784622.742698:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750123904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784622.742746:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750123904:12345-0@lo:400:kworker.0 Request processed in 49us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784622.742753:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:2.0:1787784622.742802:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784622.742805:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784622.742838:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750123904:0@lo:400:kworker.0 00010000:00080000:2.0:1787784622.742851:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12ae1c0 x1874627750124288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784622.742861:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750124288:0@lo:400:kworker.0 00000100:00100000:3.0:1787784622.745243:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750123392:0@lo:400:kworker.0 00010000:00010000:2.0:1787784623.631704:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784624.262079:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784624.262115:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750124416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784624.262236:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784624.263361:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750124416 00000100:00100000:1.0:1787784624.263379:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750124416 00000100:00100000:1.0:1787784624.263474:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787784624.263508:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750124416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787784624.263586:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787784624.263706:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750124416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 200us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784624.263715:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787784624.263939:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750124416:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787784624.657232:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787784624.779652:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:2.0:1787784625.670186:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784626.463403:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784626.463494:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784626.463722:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728013824 00000100:00100000:1.0:1787784626.463736:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728013824 00000100:00100000:1.0:1787784626.463886:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 404 00000100:00100000:1.0:1787784626.463899:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728013824:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784626.464008:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728013824:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 111us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784626.464017:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 404 00000100:00100000:0.0:1787784626.464539:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728013952 00000100:00100000:0.0:1787784626.464547:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728013952 00000100:00100000:0.0:1787784626.464623:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 252 00000100:00100000:0.0:1787784626.464633:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2664780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728013952:12345-192.168.202.41@tcp:400:kworker.0 00000100:00080000:2.0:1787784626.464823:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784626.464974:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2664780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728013952:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 340us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784626.464983:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 252 00000100:00100000:3.0:1787784626.468297:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784626.468423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784626.468470:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784626.468507:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784626.468555:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728014464 00000100:00100000:3.0:1787784626.468569:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728014464 00000100:00100000:3.0:1787784626.468650:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728014080 00000100:00100000:3.0:1787784626.468655:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728014080 00000100:00100000:3.0:1787784626.469033:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728014336 00000100:00100000:3.0:1787784626.469037:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728014336 00000100:00100000:3.0:1787784626.469076:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 253 00000100:00100000:3.0:1787784626.469088:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2664f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728014464:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784626.469313:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2664f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728014464:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 225us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784626.469323:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 253 00000100:00100000:3.0:1787784626.469346:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 254 00000100:00100000:3.0:1787784626.469354:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728014080:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784626.469384:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728014080:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 31us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784626.469390:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 254 00000100:00100000:3.0:1787784626.469402:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 255 00000100:00100000:3.0:1787784626.469407:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728014336:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784626.469431:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728014336:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784626.469438:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 255 00000100:00080000:1.0:1787784626.469761:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784626.469797:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784626.472809:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728014208 00000100:00100000:2.0:1787784626.472831:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728014208 00000100:00100000:2.0:1787784626.472961:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:2.0:1787784626.472975:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2667c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728014208:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784626.473404:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2667c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728014208:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 431us (5127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784626.473414:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00080000:1.0:1787784626.473582:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787784626.696283:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784627.337153:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784627.337191:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750124544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784627.337307:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784627.338044:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750124672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784627.338094:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784627.338220:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750124544 00000100:00100000:2.0:1787784627.338231:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750124544 00000100:00100000:2.0:1787784627.338329:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787784627.338341:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750124544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784627.338393:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787784627.338458:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750124544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.338466:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787784627.338526:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750124544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784627.339010:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750124672 00000100:00100000:1.0:1787784627.339017:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750124672 00000100:00100000:1.0:1787784627.339085:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787784627.339096:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750124672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787784627.339122:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784627.339177:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750124672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784627.339184:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787784627.339223:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750124672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784627.339416:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750124800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784627.339479:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784627.339585:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750124800 00000100:00100000:0.0:1787784627.339591:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750124800 00000100:00100000:0.0:1787784627.339642:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787784627.339652:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750124800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784627.339665:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784627.339712:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750124800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784627.339718:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787784627.339847:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787784627.339854:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8950c36f1680, transno 4294967301 00000100:00100000:3.0:1787784627.339885:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750124800:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787784627.340439:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787784627.718327:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784627.846529:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750125184:0@lo:400:kworker.0 00000100:00100000:1.0:1787784627.846646:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.846818:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750125056:0@lo:400:kworker.0 00000100:00100000:3.0:1787784627.846869:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.846948:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750125568:0@lo:400:kworker.0 00000100:00100000:3.0:1787784627.846987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.847012:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3575e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750126080:0@lo:400:kworker.0 00000100:00100000:3.0:1787784627.847149:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784627.847174:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750125056 00000100:00100000:3.0:1787784627.847176:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750126592:0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.847185:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750125056 00000100:00100000:3.0:1787784627.847203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.847235:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787784627.847243:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3574f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750125696:0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.847263:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1787784627.847277:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750125056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784627.847282:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750125568 00000100:00100000:3.0:1787784627.847287:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750125568 00000100:00100000:3.0:1787784627.847326:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787784627.847335:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750125568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.847357:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750125056:12345-0@lo:400:kworker.0 Request processed in 82us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.847366:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1787784627.847386:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750125568:12345-0@lo:400:kworker.0 Request processed in 51us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784627.847393:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787784627.847420:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750126080 00000100:00100000:3.0:1787784627.847424:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750126080 00000100:00100000:3.0:1787784627.847453:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750126592 00000100:00100000:3.0:1787784627.847471:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750126592 00000100:00100000:3.0:1787784627.847509:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787784627.847517:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750126080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784627.847555:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750126080:12345-0@lo:400:kworker.0 Request processed in 40us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784627.847562:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787784627.847566:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750125312:0@lo:400:kworker.0 00000100:00100000:3.0:1787784627.847578:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787784627.847586:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750126592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.847607:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.847634:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750126592:12345-0@lo:400:kworker.0 Request processed in 49us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.847638:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750125824:0@lo:400:kworker.0 00000100:00100000:3.0:1787784627.847644:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787784627.847690:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784627.847712:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750125312 00000100:00100000:2.0:1787784627.847716:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750125312 00000100:00100000:2.0:1787784627.847740:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787784627.847747:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750125312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.847819:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750125312:12345-0@lo:400:kworker.0 Request processed in 73us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.847839:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787784627.847866:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784627.847917:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3574780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750126336:0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.847944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784627.848490:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750125312:0@lo:400:kworker.0 00000100:00100000:0.0:1787784627.848512:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750124928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784627.848562:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784627.848588:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3576940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750125440:0@lo:400:kworker.0 00000100:00100000:0.0:1787784627.848625:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784627.852551:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750125184 00000100:00100000:1.0:1787784627.852572:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750125184 00000100:00100000:1.0:1787784627.852691:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750125824 00000100:00100000:1.0:1787784627.852695:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750125824 00000100:00100000:1.0:1787784627.852731:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750126336 00000100:00100000:1.0:1787784627.852734:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750126336 00000100:00100000:1.0:1787784627.852755:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787784627.852791:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750125184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784627.852925:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750125184:12345-0@lo:400:kworker.0 Request processed in 161us (6279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784627.852934:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787784627.852966:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787784627.852973:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750125824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784627.853013:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750125824:12345-0@lo:400:kworker.0 Request processed in 41us (5147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784627.853019:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787784627.853031:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787784627.853037:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750126336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784627.853065:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750126336:12345-0@lo:400:kworker.0 Request processed in 29us (5121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784627.853071:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:1.0:1787784627.853101:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787784627.853158:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c35752c0 x1874627750125824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784627.853180:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750125824:0@lo:400:kworker.0 00010000:00080000:1.0:1787784627.853196:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3574780 x1874627750126336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784627.853232:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3574780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750126336:0@lo:400:kworker.0 00000100:00100000:1.0:1787784627.853282:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750125184:0@lo:400:kworker.0 00000100:00100000:1.0:1787784627.853350:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750124928 00000100:00100000:1.0:1787784627.853355:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750124928 00000100:00100000:1.0:1787784627.853395:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787784627.853403:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750124928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787784627.853434:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784627.853479:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750124928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (4917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784627.853486:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787784627.853502:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784627.864880:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784627.864906:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3576d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750125952:0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.864935:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750126208:0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.865004:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784627.865028:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9d712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750126720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784627.865058:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784627.865106:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750125056:0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.865126:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750125568:0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.865143:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3575e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750126080:0@lo:400:kworker.0 00010000:00080000:2.0:1787784627.865160:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c35743c0 x1874627750126592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784627.865170:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750126592:0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.865225:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750125440 00000100:00100000:2.0:1787784627.865233:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750125440 00000100:00100000:2.0:1787784627.865286:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750125696 00000100:00100000:2.0:1787784627.865289:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750125696 00000100:00100000:2.0:1787784627.865320:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750126208 00000100:00100000:2.0:1787784627.865323:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750126208 00000100:00100000:2.0:1787784627.865340:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787784627.865350:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750125440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.865434:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750125440:12345-0@lo:400:kworker.0 Request processed in 84us (16807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.865442:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787784627.865464:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787784627.865472:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750125696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.865509:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750125696:12345-0@lo:400:kworker.0 Request processed in 38us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.865515:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787784627.865527:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787784627.865533:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750126208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.865561:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750126208:12345-0@lo:400:kworker.0 Request processed in 29us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.865567:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787784627.865589:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750126720 00000100:00100000:2.0:1787784627.865593:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750126720 00000100:00100000:2.0:1787784627.865621:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787784627.865628:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750126720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784627.865648:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784627.865682:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750126720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.865689:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1787784627.865706:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784627.865732:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3574f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750125696:0@lo:400:kworker.0 00000100:00100000:2.0:1787784627.865744:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750126208:0@lo:400:kworker.0 00010000:00080000:2.0:1787784627.865753:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d9d712c0 x1874627750126720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784627.865819:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9d712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750126720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784627.866422:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784627.866502:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750125952 00000100:00100000:2.0:1787784627.866508:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750125952 00000100:00100000:2.0:1787784627.866546:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787784627.866555:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750125952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784627.867423:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3575680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750126464:0@lo:400:kworker.0 00000100:00100000:1.0:1787784627.875531:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750125952:12345-0@lo:400:kworker.0 Request processed in 8958us (9091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784627.875553:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787784627.880345:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787784627.880490:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36f3480 x1874627750124928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784627.880527:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750124928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784627.880547:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3576940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750125440:0@lo:400:kworker.0 00000100:00100000:0.0:1787784627.880561:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3576d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750125952:0@lo:400:kworker.0 00000100:00100000:1.0:1787784627.881313:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750126464 00000100:00100000:1.0:1787784627.881327:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750126464 00000100:00100000:1.0:1787784627.881412:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787784627.881424:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750126464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784627.881518:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750126464:12345-0@lo:400:kworker.0 Request processed in 96us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784627.881527:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1787784627.881837:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3575680 x1874627750126464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784627.881853:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3575680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750126464:0@lo:400:kworker.0 00010000:00010000:2.0:1787784628.745833:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784629.383102:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750126848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784629.383230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784629.384066:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750126848 00000100:00100000:0.0:1787784629.384080:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750126848 00000100:00100000:0.0:1787784629.384166:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787784629.384178:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750126848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784629.384239:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784629.384553:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750126848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 377us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784629.384562:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787784629.385036:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750126848:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787784629.769011:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784630.152523:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787784630.794386:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784631.583035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784631.583218:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728014592 00000100:00100000:3.0:1787784631.583228:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728014592 00000100:00100000:3.0:1787784631.583322:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 406 00000100:00100000:3.0:1787784631.583334:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2406:x1874627728014592:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784631.583413:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2406:x1874627728014592:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 82us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784631.583422:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 406 00000100:00100000:3.0:1787784631.589561:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784631.589658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784631.589761:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784631.589838:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784631.589932:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728014976 00000100:00100000:2.0:1787784631.589939:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728014720 00000100:00100000:1.0:1787784631.589942:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728014976 00000100:00100000:2.0:1787784631.589943:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728014720 00000100:00100000:1.0:1787784631.590002:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:1.0:1787784631.590013:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728014976:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784631.590073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784631.590084:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728014976:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 75us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784631.590091:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:3.0:1787784631.590186:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728014848 00000100:00100000:3.0:1787784631.590191:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728014848 00000100:00100000:0.0:1787784631.590281:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728015232 00000100:00100000:0.0:1787784631.590285:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728015232 00000100:00100000:2.0:1787784631.590638:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728015104 00000100:00100000:2.0:1787784631.590643:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728015104 00000100:00100000:2.0:1787784631.590664:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 262 00000100:00100000:2.0:1787784631.590672:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728014720:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784631.590713:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728014720:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 42us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784631.590733:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 262 00000100:00100000:2.0:1787784631.590759:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 263 00000100:00100000:2.0:1787784631.590786:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2406:x1874627728015104:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784631.590813:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2406:x1874627728015104:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 48us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784631.590820:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 263 00000100:00080000:1.0:1787784631.590923:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784631.590927:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784631.590930:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784631.591300:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 264 00000100:00100000:0.0:1787784631.591308:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728015232:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784631.591341:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728015232:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 34us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784631.591348:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 264 00000100:00100000:3.0:1787784631.591975:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 265 00000100:00100000:3.0:1787784631.591986:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627728014848:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784631.592042:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627728014848:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 58us (2384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784631.592049:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 265 00010000:00010000:2.0:1787784631.814109:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784632.454133:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784632.454177:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750126976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784632.454254:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784632.454347:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750126976 00000100:00100000:3.0:1787784632.454358:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750126976 00000100:00100000:3.0:1787784632.454417:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787784632.454429:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750126976:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784632.454464:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750127104:0@lo:13:osp-pre-0-1.0 00000004:00000024:3.0:1787784632.454477:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787784632.454507:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784632.454533:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750126976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784632.454541:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787784632.454550:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750127104 00000100:00100000:2.0:1787784632.454553:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750127104 00000100:00100000:3.0:1787784632.454589:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750126976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784632.454590:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787784632.454597:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750127104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784632.454618:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787784632.454621:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784632.454651:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750127104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784632.454657:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787784632.454679:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750127104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787784632.454834:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750127232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784632.454865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784632.454930:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750127232 00000100:00100000:2.0:1787784632.454935:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750127232 00000100:00100000:2.0:1787784632.454981:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787784632.454989:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750127232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784632.454999:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784632.455031:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750127232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784632.455037:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1787784632.455103:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784632.455416:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750127232:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787784632.646581:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787784632.838561:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784632.967477:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784632.967502:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750127616:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.967587:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784632.967602:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750127360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784632.967639:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784632.967660:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784632.967665:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750127488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784632.967688:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784632.967691:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750127744:0@lo:400:kworker.0 00000100:00100000:3.0:1787784632.967725:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750127360 00000100:00100000:1.0:1787784632.967725:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784632.967741:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750127360 00000100:00100000:3.0:1787784632.967839:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750127488 00000100:00100000:3.0:1787784632.967843:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750127488 00000100:00100000:3.0:1787784632.967862:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787784632.967870:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2661e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750127360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787784632.967920:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784632.967968:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2661e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750127360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784632.967975:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787784632.967993:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787784632.968000:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2662580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750127488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784632.968012:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784632.968036:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2662580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750127488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784632.968042:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1787784632.968064:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787784632.968118:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36f1680 x1874627750127488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784632.968142:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750127488:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787784632.968154:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c36f0780 x1874627750127360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784632.968163:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750127360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784632.968193:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784632.968200:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750127872:0@lo:400:kworker.0 00000100:00100000:3.0:1787784632.968229:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784632.968230:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784632.968236:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750128000:0@lo:400:kworker.0 00000100:00100000:3.0:1787784632.968258:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750127872 00000100:00100000:3.0:1787784632.968261:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750127872 00000100:00100000:1.0:1787784632.968261:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784632.968288:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787784632.968294:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750127872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784632.968333:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750127744 00000100:00100000:3.0:1787784632.968345:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750127872:12345-0@lo:400:kworker.0 Request processed in 49us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784632.968346:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750127744 00000100:00100000:3.0:1787784632.968363:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787784632.968402:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750127872:0@lo:400:kworker.0 00000100:00100000:3.0:1787784632.968428:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750127616 00000100:00100000:3.0:1787784632.968433:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750127616 00000100:00100000:3.0:1787784632.968460:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1787784632.968466:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750127616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784632.968579:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750128000 00000100:00100000:0.0:1787784632.968585:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750128000 00000100:00100000:1.0:1787784632.968725:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750128128:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.968764:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784632.968897:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750127616:12345-0@lo:400:kworker.0 Request processed in 428us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784632.968905:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1787784632.968954:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787784632.968960:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787784632.968963:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c56283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750127744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784632.968970:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750128000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784632.968996:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c56283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750127744:12345-0@lo:400:kworker.0 Request processed in 35us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784632.969002:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787784632.969005:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750128000:12345-0@lo:400:kworker.0 Request processed in 39us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784632.969010:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787784632.969121:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750128000:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.969508:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750127744:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.969531:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750127616:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.969579:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784632.969586:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750128256:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.969623:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784632.969672:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750128384:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.969693:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784632.969751:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784632.969758:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750128512:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.970175:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784632.970308:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750128256 00000100:00100000:2.0:1787784632.970322:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750128256 00000100:00100000:3.0:1787784632.970349:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750128384 00000100:00100000:3.0:1787784632.970353:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750128384 00000100:00100000:2.0:1787784632.970365:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787784632.970374:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750128256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784632.970378:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787784632.970382:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750128384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.970490:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750128512 00000100:00100000:1.0:1787784632.970495:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750128512 00000100:00100000:2.0:1787784632.970556:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750128256:12345-0@lo:400:kworker.0 Request processed in 184us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784632.970563:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1787784632.970587:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784632.970605:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784632.970745:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787784632.970753:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5628b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750128512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784632.970879:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750128384:12345-0@lo:400:kworker.0 Request processed in 495us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784632.970886:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00010000:00080000:2.0:1787784632.971105:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c5629680 x1874627750128384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784632.971119:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750128384:0@lo:400:kworker.0 00000100:00100000:2.0:1787784632.971278:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750128512:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.971356:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5628b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750128512:12345-0@lo:400:kworker.0 Request processed in 449us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784632.971365:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787784632.971395:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750128256:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.971441:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784632.971450:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750128640:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.971480:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784632.971506:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750128640 00000100:00100000:1.0:1787784632.971510:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750128640 00000100:00100000:1.0:1787784632.971532:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787784632.971539:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c56292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750128640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.971572:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c56292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750128640:12345-0@lo:400:kworker.0 Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784632.971587:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787784632.971625:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750128640:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.971651:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750128768:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.971681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784632.971706:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750128768 00000100:00100000:1.0:1787784632.971720:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750128768 00000100:00100000:1.0:1787784632.971760:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787784632.971795:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5629e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750128768:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787784632.971938:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784632.972173:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5629e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750128768:12345-0@lo:400:kworker.0 Request processed in 405us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784632.972180:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787784632.972520:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750128896:0@lo:400:kworker.0 00000100:00100000:2.0:1787784632.972550:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784632.972619:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750128768:0@lo:400:kworker.0 00000100:00100000:3.0:1787784632.972646:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750128896 00000100:00100000:0.0:1787784632.975987:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750128128 00000100:00100000:0.0:1787784632.976018:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750128128 00000100:00100000:0.0:1787784632.976137:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787784632.976154:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750128128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784632.976297:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750128128:12345-0@lo:400:kworker.0 Request processed in 147us (7531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784632.976306:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787784632.976415:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750128128:0@lo:400:kworker.0 00000100:00100000:3.0:1787784632.976905:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750128896 00000100:00100000:3.0:1787784632.977012:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787784632.977020:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750128896:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787784632.977088:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784632.977104:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750128896:12345-0@lo:400:kworker.0 Request processed in 83us (4551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784632.977112:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:1.0:1787784632.977143:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c5628000 x1874627750128896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784632.977155:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750128896:0@lo:400:kworker.0 00010000:00010000:2.0:1787784633.862107:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784634.502397:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784634.502433:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750129024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784634.502530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784634.502698:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750129024 00000100:00100000:3.0:1787784634.502708:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750129024 00000100:00100000:3.0:1787784634.502833:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787784634.502844:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750129024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784634.502903:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787784634.502969:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750129024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784634.502977:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787784634.503242:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750129024:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787784634.886267:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784635.911393:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784636.707385:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784636.707438:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784636.707482:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784636.707590:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728015616 00000100:00100000:0.0:1787784636.707600:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728015616 00000100:00100000:0.0:1787784636.707673:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728015488 00000100:00100000:0.0:1787784636.707687:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728015488 00000100:00100000:0.0:1787784636.707724:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 272 00000100:00100000:0.0:1787784636.707735:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627728015616:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784636.707863:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627728015616:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 129us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784636.707870:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 272 00000100:00100000:0.0:1787784636.707889:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 273 00000100:00100000:3.0:1787784636.707892:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728015360 00000100:00100000:0.0:1787784636.707895:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3576d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627728015488:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784636.707896:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728015360 00000100:00100000:3.0:1787784636.707926:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 408 00000100:00100000:0.0:1787784636.707932:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3576d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627728015488:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 37us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784636.707933:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2406:x1874627728015360:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784636.707955:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 273 00000100:00100000:3.0:1787784636.707957:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2406:x1874627728015360:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784636.707963:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 408 00000100:00080000:2.0:1787784636.708049:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784636.708053:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784636.722063:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784636.722625:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728015744 00000100:00100000:3.0:1787784636.722635:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728015744 00000100:00100000:3.0:1787784636.722741:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:3.0:1787784636.722753:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2404:x1874627728015744:12345-192.168.202.41@tcp:9:kworker.0 00000100:00080000:0.0:1787784636.723996:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784636.724597:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784636.724693:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784636.725087:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728016000 00000100:00100000:3.0:1787784636.725104:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728016000 00000100:00100000:3.0:1787784636.725180:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728015872 00000100:00100000:3.0:1787784636.725184:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728015872 00000100:00080000:2.0:1787784636.725274:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784636.725277:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:1.0:1787784636.730517:0:8916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cf4d 00000100:00080000:1.0:1787784636.730542:0:8916:0:(import.c:65:import_set_state_nolock()) ffff8950c344b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787784636.730611:0:8916:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1787784636.730959:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+2:2404:x1874627728015744:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 8204us (8902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784636.730988:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00010000:00010000:1.0:1787784636.731027:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784636.731331:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 274 00000100:00100000:3.0:1787784636.731347:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3576940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2406:x1874627728016000:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784636.731515:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3576940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2406:x1874627728016000:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 174us (6921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784636.731522:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 274 00000100:00100000:3.0:1787784636.731537:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 275 00000100:00100000:3.0:1787784636.731544:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2406:x1874627728015872:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784636.731571:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2406:x1874627728015872:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 27us (6878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784636.731577:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 275 00010000:00010000:2.0:1787784636.934073:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784637.574054:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784637.574080:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750129152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784637.574172:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784637.574211:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2661680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750129408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784637.574240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784637.574242:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750129280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784637.574295:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750129152 00000100:00100000:0.0:1787784637.574304:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750129152 00000100:00100000:0.0:1787784637.574351:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750129408 00000100:00100000:0.0:1787784637.574354:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750129408 00000100:00100000:0.0:1787784637.574373:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787784637.574382:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750129152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784637.574417:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787784637.574441:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784637.574463:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787784637.574472:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2663c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750129408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784637.574483:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784637.579721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784637.580074:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750129280 00000100:00100000:3.0:1787784637.580084:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750129280 00000100:00100000:3.0:1787784637.580152:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787784637.580161:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5629a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750129280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787784637.580197:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787784637.580259:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5629a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750129280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784637.580266:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787784637.580492:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750129280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784637.587258:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750129152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12854us (13062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784637.587283:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787784637.587970:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750129152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784637.593633:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2663c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750129408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 19152us (19381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784637.593649:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787784637.593868:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2661680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750129408:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787784637.959208:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784638.086004:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784638.086028:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750129536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784638.086112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784638.086187:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750129536 00000100:00100000:1.0:1787784638.086194:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750129536 00000100:00100000:0.0:1787784638.086229:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784638.086238:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750129664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784638.086243:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787784638.086267:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5628780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750129536:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784638.086267:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784638.086296:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750129664 00002000:00000024:1.0:1787784638.086297:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784638.086299:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750129664 00000100:00100000:0.0:1787784638.086320:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787784638.086326:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750129664:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784638.086336:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5628780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750129536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (225us total) trans 0 rc 0/0 00002000:00000024:0.0:1787784638.086336:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784638.086343:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787784638.086362:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750129664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784638.086368:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:1.0:1787784638.086379:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c5628f00 x1874627750129536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787784638.086386:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12acf00 x1874627750129664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784638.086397:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750129536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784638.086414:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750129664:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787784638.086442:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784638.086472:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750129792:0@lo:400:kworker.0 00000100:00100000:1.0:1787784638.086500:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784638.086524:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750130304:0@lo:400:kworker.0 00000100:00100000:1.0:1787784638.086545:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784638.086546:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750130048:0@lo:400:kworker.0 00000100:00100000:1.0:1787784638.086563:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750130816:0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.086568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784638.086583:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750130560:0@lo:400:kworker.0 00000100:00100000:1.0:1787784638.086584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784638.086599:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787784638.086604:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784638.086605:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750130176:0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.086619:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750131072:0@lo:400:kworker.0 00000100:00100000:1.0:1787784638.086623:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784638.086637:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750130688:0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.086638:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784638.086652:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787784638.086655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784638.086657:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750129920:0@lo:400:kworker.0 00000100:00100000:3.0:1787784638.086718:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750129792 00000100:00100000:3.0:1787784638.086728:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750129792 00000100:00100000:3.0:1787784638.086760:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1787784638.086766:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750129792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784638.086890:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750130560 00000100:00100000:2.0:1787784638.086895:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750130560 00000100:00100000:2.0:1787784638.086931:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750130176 00000100:00100000:2.0:1787784638.086934:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750130176 00000100:00100000:2.0:1787784638.086954:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750131072 00000100:00100000:2.0:1787784638.086957:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750131072 00000100:00100000:2.0:1787784638.086974:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787784638.086981:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750130560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.090428:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784638.090474:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750130432:0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.090516:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784638.090528:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750130944:0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.090547:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784638.090610:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750129920 00000100:00100000:0.0:1787784638.090617:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750129920 00000100:00100000:0.0:1787784638.090656:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750130432 00000100:00100000:0.0:1787784638.090659:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750130432 00000100:00100000:0.0:1787784638.090675:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750130944 00000100:00100000:0.0:1787784638.090677:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750130944 00000100:00100000:0.0:1787784638.090715:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787784638.090724:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5629680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750130176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.090835:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5629680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750130176:12345-0@lo:400:kworker.0 Request processed in 111us (4209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784638.090857:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787784638.090877:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787784638.090884:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750131072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.090922:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750131072:12345-0@lo:400:kworker.0 Request processed in 39us (4283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784638.090928:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787784638.090954:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787784638.090960:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750129920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.090987:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750129920:12345-0@lo:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784638.090993:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787784638.091004:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787784638.091008:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750130432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.091033:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750130432:12345-0@lo:400:kworker.0 Request processed in 25us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784638.091039:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787784638.091049:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787784638.091055:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750130944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.091080:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750130944:12345-0@lo:400:kworker.0 Request processed in 26us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784638.091086:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787784638.091109:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750130816 00000100:00100000:0.0:1787784638.091113:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750130816 00000100:00100000:0.0:1787784638.091138:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750130688 00000100:00100000:0.0:1787784638.091141:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750130688 00000100:00100000:0.0:1787784638.091170:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787784638.091176:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750130816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.091209:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750130816:12345-0@lo:400:kworker.0 Request processed in 34us (4625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784638.091215:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787784638.091226:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787784638.091231:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750130688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.091257:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750130688:12345-0@lo:400:kworker.0 Request processed in 26us (4601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784638.091263:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787784638.091300:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750129920:0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.091311:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750130432:0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.091320:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750130944:0@lo:400:kworker.0 00010000:00080000:0.0:1787784638.091332:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c562c000 x1874627750131072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784638.091343:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750131072:0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.091488:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750130304 00000100:00100000:0.0:1787784638.091492:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750130304 00000100:00100000:0.0:1787784638.091512:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750130048 00000100:00100000:0.0:1787784638.091515:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750130048 00000100:00100000:0.0:1787784638.091527:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787784638.091533:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5628f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750130304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.091568:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5628f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750130304:12345-0@lo:400:kworker.0 Request processed in 35us (5022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784638.091574:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787784638.091594:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787784638.091600:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750130048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784638.091635:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750130048:12345-0@lo:400:kworker.0 Request processed in 35us (5066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784638.091641:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787784638.091671:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750130048:0@lo:400:kworker.0 00000100:00080000:0.0:1787784638.091714:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784638.091718:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787784638.095917:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750130688:0@lo:400:kworker.0 00000100:00100000:1.0:1787784638.095937:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750130816:0@lo:400:kworker.0 00000100:00100000:1.0:1787784638.095951:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750130304:0@lo:400:kworker.0 00000100:00100000:1.0:1787784638.095982:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750130176:0@lo:400:kworker.0 00000100:00100000:3.0:1787784638.098820:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750129792:12345-0@lo:400:kworker.0 Request processed in 12044us (12308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784638.098836:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1787784638.099872:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750129792:0@lo:400:kworker.0 00000100:00100000:2.0:1787784638.104586:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750130560:12345-0@lo:400:kworker.0 Request processed in 17594us (17968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784638.104602:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00080000:0.0:1787784638.104817:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c562fc00 x1874627750130560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784638.104836:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750130560:0@lo:400:kworker.0 00010000:00010000:1.0:1787784638.983526:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784639.623925:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750131200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784639.624002:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784639.624242:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750131200 00000100:00100000:0.0:1787784639.624251:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750131200 00000100:00100000:0.0:1787784639.624304:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787784639.624314:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750131200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784639.624346:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784639.624444:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750131200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784639.624452:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787784639.624817:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750131200:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787784640.006083:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784640.394111:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787784641.032669:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784641.824957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784641.824995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784641.825016:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784641.825051:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784641.825076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784641.825099:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728016384 00000100:00100000:0.0:1787784641.825120:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728016384 00000100:00100000:0.0:1787784641.825177:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728016640 00000100:00100000:0.0:1787784641.825180:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728016640 00000100:00100000:0.0:1787784641.825191:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728016256 00000100:00100000:0.0:1787784641.825193:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728016256 00000100:00100000:0.0:1787784641.825215:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728016512 00000100:00100000:0.0:1787784641.825217:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728016512 00000100:00100000:0.0:1787784641.825232:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 282 00000100:00100000:0.0:1787784641.825241:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728016384:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784641.825313:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728016384:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 73us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784641.825319:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 282 00000100:00100000:0.0:1787784641.825335:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 283 00000100:00100000:0.0:1787784641.825341:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728016640:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784641.825364:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728016640:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784641.825370:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 283 00000100:00100000:0.0:1787784641.825394:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 284 00000100:00100000:0.0:1787784641.825400:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728016256:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784641.825424:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728016256:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784641.825429:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 284 00000100:00100000:0.0:1787784641.825439:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 285 00000100:00100000:0.0:1787784641.825444:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728016512:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784641.825463:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728016512:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 19us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784641.825476:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 285 00000100:00080000:0.0:1787784641.825504:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784641.825507:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784641.825818:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728016128 00000100:00100000:3.0:1787784641.825824:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728016128 00000100:00100000:3.0:1787784641.825856:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 410 00000100:00100000:3.0:1787784641.825862:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728016128:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784641.825898:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728016128:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 35us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784641.825904:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 410 00010000:00010000:1.0:1787784642.058507:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784642.694192:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750131328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784642.694267:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784642.694349:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750131328 00000100:00100000:1.0:1787784642.694356:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750131328 00000100:00100000:1.0:1787784642.694408:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787784642.694426:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750131328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784642.694457:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784642.694555:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750131328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784642.694562:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1787784642.694583:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784642.694752:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750131328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784642.695093:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750131456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784642.695128:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784642.695683:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750131456 00000100:00100000:2.0:1787784642.695688:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750131456 00000100:00100000:2.0:1787784642.695734:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787784642.695742:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750131456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784642.695796:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787784642.695841:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750131456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784642.695854:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787784642.696038:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750131456:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1787784642.696855:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00000020:00000080:2.0:1787784642.696862:0:8431:0:(genops.c:885:class_export_put()) final put ffff8950c344d000/2e90d38f-8956-47bc-80da-c902c22ae09c 00000020:00000080:0.0:1787784642.697000:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c344d000/2e90d38f-8956-47bc-80da-c902c22ae09c for lustre-OST0000 00000020:00000080:0.0:1787784642.697038:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c344b000 for lustre-OST0000 00000100:00100000:2.0:1787784642.697255:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750131584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784642.697308:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784642.697544:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750131584 00000100:00100000:2.0:1787784642.697550:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750131584 00000100:00100000:2.0:1787784642.697872:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787784642.697883:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750131584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784642.697902:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784642.697944:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750131584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784642.697951:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1787784642.698083:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784642.698152:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750131584:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1787784642.887204:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787784643.078096:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784643.207842:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750131712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784643.207917:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784643.207999:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750131712 00000100:00100000:0.0:1787784643.208007:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750131712 00000100:00100000:0.0:1787784643.208064:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787784643.208074:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750131712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784643.208103:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784643.208147:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750131712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784643.208154:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1787784643.208174:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787784643.208200:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c562c000 x1874627750131712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784643.208220:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750131712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784643.209953:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750131968:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.210012:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784643.210050:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750132480:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.210072:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784643.210096:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750132992:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.210119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784643.210150:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787784643.210159:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750132096:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.210200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784643.210219:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750132608:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.210239:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784643.210260:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750133120:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.210284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784643.210332:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750132096 00000100:00100000:2.0:1787784643.210337:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750132096 00000100:00100000:2.0:1787784643.210384:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787784643.210391:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750132096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.210444:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750132096:12345-0@lo:400:kworker.0 Request processed in 53us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784643.210452:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787784643.210474:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750131968 00000100:00100000:2.0:1787784643.210477:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750131968 00000100:00100000:2.0:1787784643.210501:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750132480 00000100:00100000:2.0:1787784643.210504:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750132480 00000100:00100000:2.0:1787784643.210524:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750132992 00000100:00100000:2.0:1787784643.210527:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750132992 00000100:00100000:2.0:1787784643.210542:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750132608 00000100:00100000:2.0:1787784643.210545:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750132608 00000100:00100000:2.0:1787784643.210556:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750133120 00000100:00100000:2.0:1787784643.210561:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750133120 00000100:00100000:2.0:1787784643.210576:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787784643.210585:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750131968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.210629:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750131968:12345-0@lo:400:kworker.0 Request processed in 44us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784643.210635:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787784643.210690:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787784643.210703:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750132480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.210733:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750132480:12345-0@lo:400:kworker.0 Request processed in 31us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784643.210740:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787784643.210751:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787784643.210757:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750132992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.210807:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750132992:12345-0@lo:400:kworker.0 Request processed in 50us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784643.210813:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787784643.210823:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787784643.210829:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750132608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.210854:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750132608:12345-0@lo:400:kworker.0 Request processed in 26us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784643.210859:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787784643.210871:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787784643.210877:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750133120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.210902:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750133120:12345-0@lo:400:kworker.0 Request processed in 26us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784643.210907:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787784643.211019:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750132096:0@lo:400:kworker.0 00010000:00080000:2.0:1787784643.211036:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c40c4b40 x1874627750132608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784643.211050:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750132608:0@lo:400:kworker.0 00010000:00080000:2.0:1787784643.211059:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c40c6d00 x1874627750133120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784643.211527:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750133120:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.211544:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750131968:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.211554:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750132480:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.211563:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750132992:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.211604:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750131840:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.211649:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784643.211685:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750132352:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.211707:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784643.211723:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750132864:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.211747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784643.211804:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787784643.211811:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff48ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750132224:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.211833:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784643.211849:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750132736:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.211868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784643.211883:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750133248:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.211903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784643.211927:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750132352 00000100:00100000:2.0:1787784643.211932:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750132352 00000100:00100000:2.0:1787784643.211957:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787784643.211965:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750132352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.212004:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750132352:12345-0@lo:400:kworker.0 Request processed in 40us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784643.212019:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787784643.212049:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750132224 00000100:00100000:2.0:1787784643.212052:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750132224 00000100:00100000:2.0:1787784643.212070:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787784643.212075:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750132224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.212104:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750132224:12345-0@lo:400:kworker.0 Request processed in 29us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784643.212110:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787784643.212135:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff48ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750132224:0@lo:400:kworker.0 00000100:00100000:2.0:1787784643.212144:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750132352:0@lo:400:kworker.0 00000100:00100000:0.0:1787784643.212947:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750132864 00000100:00100000:0.0:1787784643.212954:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750132864 00000100:00100000:0.0:1787784643.212995:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750132736 00000100:00100000:0.0:1787784643.212998:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750132736 00000100:00100000:0.0:1787784643.213009:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750133248 00000100:00100000:0.0:1787784643.213012:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750133248 00000100:00100000:0.0:1787784643.213028:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787784643.213035:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750132864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784643.213087:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750132864:12345-0@lo:400:kworker.0 Request processed in 53us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784643.213094:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787784643.213106:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787784643.213111:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750132736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784643.213137:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750132736:12345-0@lo:400:kworker.0 Request processed in 26us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784643.213142:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787784643.213153:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787784643.213159:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750133248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784643.213187:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750133248:12345-0@lo:400:kworker.0 Request processed in 29us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784643.213193:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787784643.213230:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750132736:0@lo:400:kworker.0 00010000:00080000:0.0:1787784643.213243:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c40c5a40 x1874627750133248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784643.213254:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750133248:0@lo:400:kworker.0 00000100:00100000:0.0:1787784643.213265:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750132864:0@lo:400:kworker.0 00000100:00080000:0.0:1787784643.213292:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784643.213690:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750131840 00000100:00100000:3.0:1787784643.213696:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750131840 00000100:00100000:3.0:1787784643.213740:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1787784643.213747:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750131840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784643.213807:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750131840:12345-0@lo:400:kworker.0 Request processed in 60us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784643.213813:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1787784643.213952:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750131840:0@lo:400:kworker.0 00000100:00080000:0.0:1787784643.217466:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787784643.217470:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784643.217914:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750133376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784643.217989:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784643.225827:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750133376 00000100:00100000:0.0:1787784643.225840:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750133376 00000100:00100000:0.0:1787784643.225895:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787784643.225905:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750133376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787784643.225931:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784643.226010:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750133376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (8020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784643.226016:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:0.0:1787784643.226054:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c26603c0 x1874627750133376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784643.226073:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750133376:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787784644.103008:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784644.742188:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750133504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784644.742266:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784644.742605:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750133504 00000100:00100000:0.0:1787784644.742614:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750133504 00000100:00100000:0.0:1787784644.742685:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787784644.742695:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750133504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784644.742729:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784644.742822:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750133504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784644.742830:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787784644.743292:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750133504:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787784645.126709:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784646.161980:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787784646.224147:0:14073:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 18:50:44 (1787784644) 00000100:00100000:0.0:1787784646.942822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784646.942869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784646.942897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784646.942945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784646.942972:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784646.942997:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728017024 00000100:00100000:0.0:1787784646.943006:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728017024 00000100:00100000:0.0:1787784646.943054:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728017280 00000100:00100000:0.0:1787784646.943057:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728017280 00000100:00100000:0.0:1787784646.943070:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728016896 00000100:00100000:0.0:1787784646.943072:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728016896 00000100:00100000:0.0:1787784646.943083:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728017152 00000100:00100000:0.0:1787784646.943085:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728017152 00000100:00100000:0.0:1787784646.943116:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 292 00000100:00100000:0.0:1787784646.943126:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728017024:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784646.943196:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728017024:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 71us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784646.943204:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 292 00000100:00100000:0.0:1787784646.943218:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 293 00000100:00100000:0.0:1787784646.943225:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728017280:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784646.943247:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728017280:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784646.943253:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 293 00000100:00100000:0.0:1787784646.943263:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 294 00000100:00100000:0.0:1787784646.943269:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728016896:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784646.943289:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728016896:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 21us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784646.943295:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 294 00000100:00100000:0.0:1787784646.943305:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 295 00000100:00100000:0.0:1787784646.943317:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728017152:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784646.943339:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728017152:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784646.943358:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 295 00000100:00080000:0.0:1787784646.943377:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784646.943380:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784646.944046:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728016768 00000100:00100000:3.0:1787784646.944053:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728016768 00000100:00100000:3.0:1787784646.944107:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 412 00000100:00100000:3.0:1787784646.944115:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2407:x1874627728016768:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784646.944165:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2407:x1874627728016768:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 51us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784646.944172:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 412 00010000:00010000:0.0:1787784647.174352:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784647.814064:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750133760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784647.814135:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784647.814144:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784647.814150:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750133632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784647.814180:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784647.814285:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784647.814294:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750133888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784647.814328:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784647.819259:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750133760 00000100:00100000:3.0:1787784647.819280:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750133760 00000100:00100000:0.0:1787784647.822059:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750133632 00000100:00100000:0.0:1787784647.822076:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750133632 00000100:00100000:2.0:1787784647.838404:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750133888 00000100:00100000:2.0:1787784647.838420:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750133888 00000100:00100000:2.0:1787784647.838502:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787784647.838513:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750133888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784647.838560:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787784647.838573:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787784647.838595:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750133760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784647.838655:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784647.839021:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750133760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 435us (24875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784647.839030:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787784647.841498:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750133760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784647.841932:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750133888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3411us (27592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784647.841948:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787784647.843517:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750133888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784647.844127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784647.844134:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787784647.844148:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750133632:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784647.844159:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728017408 00000100:00100000:0.0:1787784647.844165:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728017408 00002000:00000024:1.0:1787784647.844174:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784647.844194:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:0.0:1787784647.844201:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:11094:x1874627728017408:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784647.844212:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784647.844235:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e729ba expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784647.844236:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750133632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (30054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784647.844243:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00010000:0.0:1787784647.844303:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d07a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.844319:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d07a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.844335:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d07a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784647.844402:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787784647.844406:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784647.844446:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d07a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.844472:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729ba expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.844491:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d07a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729ba expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.844501:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128000) 00010000:00010000:0.0:1787784647.844504:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784647.844508:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629200, rc 0) 00000100:00100000:0.0:1787784647.844560:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:11094:x1874627728017408:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 359us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784647.844568:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:0.0:1787784647.848835:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750133632:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787784647.849732:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784647.881065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784647.881208:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728017536 00000100:00100000:0.0:1787784647.881222:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728017536 00000100:00100000:0.0:1787784647.881297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:0.0:1787784647.881311:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:11095:x1874627728017536:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784647.881338:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784647.881370:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e729c1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881458:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d088 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881473:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d088 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881484:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d088 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881498:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d08f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881504:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d08f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881510:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d08f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881569:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9d096 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881577:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9d096 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881584:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9d096 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784647.881637:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787784647.881642:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784647.881663:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9d096 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881686:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d088 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881874:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d088 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881881:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d088 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881888:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784647.881892:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d088 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881899:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d088 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881912:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128000) 00010000:00010000:0.0:1787784647.881915:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784647.881918:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d088 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881924:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d088 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881938:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d08f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881944:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d08f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881949:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d08f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881961:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784647.881963:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d08f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881969:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d08f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881977:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8951f5128300) 00010000:00010000:0.0:1787784647.881979:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784647.881982:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d08f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.881988:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d08f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.882023:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d081 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729c1 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.882036:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9d096 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729c1 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.882042:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8951f5128200) 00010000:00010000:0.0:1787784647.882044:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784647.882047:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628600, rc 0) 00000100:00100000:0.0:1787784647.882110:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:11095:x1874627728017536:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 802us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784647.882119:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:1.0:1787784647.895135:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784647.895242:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728017664 00000100:00100000:3.0:1787784647.895253:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728017664 00000100:00100000:3.0:1787784647.895324:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:3.0:1787784647.895348:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:11095:x1874627728017664:12345-192.168.202.41@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787784647.895474:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:11095:x1874627728017664:12345-192.168.202.41@tcp:900:lhsmtool_posix.0 Request processed in 129us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784647.895482:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1787784647.906263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784647.906384:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728017920 00000100:00100000:0.0:1787784647.906409:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728017920 00000100:00100000:0.0:1787784647.906492:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:0.0:1787784647.906504:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:11095:x1874627728017920:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784647.906525:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784647.906546:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d09d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e729c8 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.906637:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d0a4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.906653:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d0a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.906664:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d0a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.906749:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d0ab lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.906757:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d0ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.906764:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d0ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.906913:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9d0b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.906922:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9d0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.906930:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9d0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784647.906950:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787784647.907043:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d0a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907051:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d0a4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907058:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d0a4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907064:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784647.907069:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d0a4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907077:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d0a4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907090:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8951f5128200) 00010000:00010000:0.0:1787784647.907093:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784647.907098:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d0a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907104:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d0a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907118:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d0ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907123:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d0ab lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907137:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d0ab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907142:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784647.907145:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d0ab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907151:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d0ab lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907158:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8951f5128300) 00010000:00010000:0.0:1787784647.907161:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784647.907164:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d0ab lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907170:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d0ab lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907431:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d09d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729c8 expref: 10 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907448:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9d0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729c8 expref: 9 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784647.907455:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951f5128c00) 00010000:00010000:0.0:1787784647.907458:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784647.907460:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629800, rc 0) 00000100:00100000:0.0:1787784647.907527:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+9:11095:x1874627728017920:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1025us (1276us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787784647.907543:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:1.0:1787784647.921862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784647.921957:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728018048 00000100:00100000:0.0:1787784647.921967:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728018048 00000100:00100000:0.0:1787784647.922015:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:0.0:1787784647.922023:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+9:11095:x1874627728018048:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787784647.922116:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+9:11095:x1874627728018048:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 94us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784647.922124:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:1.0:1787784647.928048:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784647.928158:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728018176 00000100:00100000:2.0:1787784647.928169:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728018176 00000100:00100000:2.0:1787784647.928239:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:2.0:1787784647.928249:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:11095:x1874627728018176:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1787784647.932079:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3789us 00000100:00100000:1.0:1787784647.981948:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:11095:x1874627728018176:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 53686us (53898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784647.981963:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 44 00000040:00080000:2.0:1787784648.006447:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787784648.207113:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784648.326085:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750134016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784648.326152:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784648.326266:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750134016 00000100:00100000:0.0:1787784648.326273:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750134016 00000100:00100000:0.0:1787784648.326324:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787784648.326332:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750134016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784648.326371:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784648.326436:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750134016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784648.326443:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:0.0:1787784648.326492:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c7e97840 x1874627750134016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784648.326511:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750134016:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787784648.327012:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784648.327257:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784648.327276:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750134144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784648.327316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784648.327660:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750134144 00000100:00100000:3.0:1787784648.327666:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750134144 00000100:00100000:3.0:1787784648.327719:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787784648.327743:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750134144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787784648.327763:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787784648.327844:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784648.331458:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750134144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3706us (4131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784648.331473:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:0.0:1787784648.331580:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c26630c0 x1874627750134144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784648.331616:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750134144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784648.332422:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784648.332502:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784648.332516:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750134400:0@lo:400:kworker.0 00000100:00100000:1.0:1787784648.332566:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784648.334395:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750134400 00000100:00100000:3.0:1787784648.334410:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750134400 00000100:00100000:3.0:1787784648.334484:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787784648.334495:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750134400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784648.334588:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750134400:12345-0@lo:400:kworker.0 Request processed in 95us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784648.334607:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787784648.334659:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750134400:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.339858:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750134272:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.339933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784648.339986:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750134272 00000100:00100000:0.0:1787784648.339993:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750134272 00000100:00100000:0.0:1787784648.340032:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1787784648.340038:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750134272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.340076:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750134272:12345-0@lo:400:kworker.0 Request processed in 38us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784648.340081:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1787784648.340115:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750134272:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.340993:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784648.341006:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750134528:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341050:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784648.341086:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750134528 00000100:00100000:0.0:1787784648.341091:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750134528 00000100:00100000:0.0:1787784648.341123:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787784648.341131:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750134528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341168:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750134528:12345-0@lo:400:kworker.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784648.341174:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787784648.341204:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750134528:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341233:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750134656:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784648.341281:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750134656 00000100:00100000:0.0:1787784648.341296:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750134656 00000100:00100000:0.0:1787784648.341321:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787784648.341327:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750134656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341361:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750134656:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784648.341367:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787784648.341393:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750134656:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341426:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750134784:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341450:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784648.341478:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750134784 00000100:00100000:0.0:1787784648.341481:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750134784 00000100:00100000:0.0:1787784648.341512:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787784648.341518:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750134784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341552:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750134784:12345-0@lo:400:kworker.0 Request processed in 34us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784648.341559:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:0.0:1787784648.341574:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784648.341606:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750134784:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341639:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750134912:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784648.341688:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750134912 00000100:00100000:0.0:1787784648.341691:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750134912 00000100:00100000:0.0:1787784648.341716:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787784648.341722:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750134912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341755:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750134912:12345-0@lo:400:kworker.0 Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784648.341794:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:0.0:1787784648.341810:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787784648.341830:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c7e97840 x1874627750134912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784648.341841:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750134912:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341868:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784648.341874:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750135040:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341897:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784648.341919:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750135040 00000100:00100000:0.0:1787784648.341922:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750135040 00000100:00100000:0.0:1787784648.341948:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787784648.341954:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750135040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.341989:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750135040:12345-0@lo:400:kworker.0 Request processed in 35us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784648.341996:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:0.0:1787784648.342009:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784648.342025:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750135040:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.342056:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750135168:0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.342078:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784648.342100:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750135168 00000100:00100000:0.0:1787784648.342104:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750135168 00000100:00100000:0.0:1787784648.342128:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787784648.342134:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750135168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784648.342165:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750135168:12345-0@lo:400:kworker.0 Request processed in 32us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784648.342180:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:0.0:1787784648.342194:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787784648.342211:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c7e97840 x1874627750135168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784648.342221:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750135168:0@lo:400:kworker.0 00000040:00080000:0.0:1787784648.584193:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784649.222131:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784649.863636:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784649.863671:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750135296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784649.863799:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784649.864387:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750135296 00000100:00100000:0.0:1787784649.864398:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750135296 00000100:00100000:0.0:1787784649.864477:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787784649.864490:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750135296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784649.864540:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787784649.864625:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750135296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784649.864634:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787784649.864704:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750135296:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784650.246424:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784650.456009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784650.456104:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728018304 00000100:00100000:1.0:1787784650.456114:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728018304 00000100:00100000:1.0:1787784650.456190:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:1.0:1787784650.456202:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2660b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+9:11137:x1874627728018304:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787784650.456221:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784650.456247:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9d0c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e729cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456314:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d0c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456328:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d0c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456340:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d0c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456363:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d0ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456371:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d0ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456378:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d0ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456419:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d0c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456426:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d0c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456433:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d0c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456439:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784650.456443:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d0c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456450:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d0c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787784650.456458:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787784650.456462:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128000) 00010000:00010000:1.0:1787784650.456465:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784650.456469:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d0c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456476:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d0c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456495:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d0ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456501:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d0ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456506:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d0ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456511:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784650.456514:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d0ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456520:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d0ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456528:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8950c26a3300) 00010000:00010000:1.0:1787784650.456530:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784650.456533:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d0ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456539:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d0ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456568:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9d0c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729cf expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456589:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128000) 00010000:00010000:1.0:1787784650.456591:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784650.456596:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9d0c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729cf expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784650.456611:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603a00, rc 0) 00000100:00100000:1.0:1787784650.456674:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2660b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+9:11137:x1874627728018304:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 474us (675us total) trans 0 rc 301/301 00000100:00100000:1.0:1787784650.456683:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:1.0:1787784650.462087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784650.462186:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728018560 00000100:00100000:2.0:1787784650.462197:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728018560 00000100:00100000:2.0:1787784650.462256:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:2.0:1787784650.462267:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+9:11137:x1874627728018560:12345-192.168.202.41@tcp:36:lfs.0 00010000:00010000:2.0:1787784650.462325:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784650.462352:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d07a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729ba expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.462371:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128000) 00010000:00010000:2.0:1787784650.462381:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784650.462444:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d0d5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.462477:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d0d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.462487:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d0d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.462515:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff600/0x88ace7295d9d0dc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.462523:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff600/0x88ace7295d9d0dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.462530:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff600/0x88ace7295d9d0dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.463437:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff400/0x88ace7295d9d0e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.463454:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff400/0x88ace7295d9d0e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.463612:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff400/0x88ace7295d9d0e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784650.463634:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000059c5261 reply state 000000006e95bc1c transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff400/0x88ace7295d9d0e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.463647:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff400/0x88ace7295d9d0e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.463654:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784650.463657:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784650.463661:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787784650.463666:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787784650.463674:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d0d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.463681:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d0d5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.463697:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d0d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.463704:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c13ff000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784650.463708:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d0d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.463716:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d0d5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.463726:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951e0a67e00) 00010000:00010000:2.0:1787784650.463728:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784650.463731:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d0d5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.463737:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d0d5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784650.463758:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000059c5261 reply state 000000006e95bc1c transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff600/0x88ace7295d9d0dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.463790:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff600/0x88ace7295d9d0dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.463796:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8951e0a67a00) 00010000:00010000:2.0:1787784650.463799:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784650.463801:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787784650.463918:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+10:11137:x1874627728018560:12345-192.168.202.41@tcp:36:lfs.0 Request processed in 1650us (1839us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787784650.463927:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:2.0:1787784650.593851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784650.593982:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728018688 00000100:00100000:0.0:1787784650.593997:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728018688 00000100:00100000:0.0:1787784650.594079:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:0.0:1787784650.594092:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+10:11145:x1874627728018688:12345-192.168.202.41@tcp:101:lctl.0 00010000:00010000:0.0:1787784650.594125:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784650.594157:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d0ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e729d6 expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.594322:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d0f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.594339:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.594365:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784650.594423:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787784650.594427:0:11332:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784650.594999:0:11332:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.595038:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d0ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729d6 expref: 12 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.595058:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729d6 expref: 11 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.595067:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128300) 00010000:00010000:0.0:1787784650.595070:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784650.595073:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629200, rc 0) 00000100:00100000:0.0:1787784650.595152:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+11:11145:x1874627728018688:12345-192.168.202.41@tcp:101:lctl.0 Request processed in 1063us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784650.595161:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000040:00080000:3.0:1787784650.640549:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787784650.733860:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784650.734048:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728018816 00000100:00100000:3.0:1787784650.734062:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728018816 00000100:00100000:3.0:1787784650.734140:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:3.0:1787784650.734154:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+11:11151:x1874627728018816:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1787784650.734182:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784650.734210:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d0f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e729dd expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.734455:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d0ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.734472:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d0ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.734486:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d0ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.734525:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d106 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.734534:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d106 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.734542:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d106 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.734667:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9d10d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.734676:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9d10d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.734684:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9d10d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784650.734732:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787784650.734736:0:7991:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787784650.738986:0:7991:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9d10d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739025:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d0ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739032:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d0ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739040:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d0ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739071:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784650.739076:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d0ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739085:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d0ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739108:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128300) 00010000:00010000:3.0:1787784650.739111:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784650.739117:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d0ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739123:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d0ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739147:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d106 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739154:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d106 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739159:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d106 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739165:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784650.739167:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d106 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739172:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d106 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739191:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8951e0a67a00) 00010000:00010000:3.0:1787784650.739193:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784650.739196:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d106 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739202:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d106 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739254:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d0f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729dd expref: 13 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739273:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9d10d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729dd expref: 12 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.739281:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:3.0:1787784650.739283:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787784650.739286:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712200, rc 0) 00000100:00100000:3.0:1787784650.739404:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+12:11151:x1874627728018816:12345-192.168.202.41@tcp:101:bash.0 Request processed in 5253us (5557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784650.739415:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:2.0:1787784650.744825:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784650.744936:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728019072 00000100:00100000:0.0:1787784650.744951:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728019072 00000100:00100000:0.0:1787784650.745030:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:0.0:1787784650.745042:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+12:11151:x1874627728019072:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1787784650.745072:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784650.745100:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d114 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e729e4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.745281:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d11b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.745299:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d11b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.745314:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d11b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.745538:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d122 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.745561:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.745585:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787784650.746358:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787784650.746643:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d129 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.746656:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.746665:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.746701:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d11b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.746720:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d11b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.746726:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d11b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.746732:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784650.746735:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d11b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.746742:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d11b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.746754:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:0.0:1787784650.746757:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784650.746761:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d11b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.746799:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d11b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787784650.747504:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bf1e874 reply state 0000000063ad19a4 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.747518:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.747525:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8951f5128e00) 00010000:00010000:0.0:1787784650.747528:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787784650.747531:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787784650.747583:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d114 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729e4 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.747607:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729e4 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.747615:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128b00) 00010000:00010000:0.0:1787784650.747618:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784650.747620:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628800, rc 0) 00000100:00100000:0.0:1787784650.747987:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+15:11151:x1874627728019072:12345-192.168.202.41@tcp:101:bash.0 Request processed in 2939us (3212us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787784650.747997:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:1.0:1787784650.763594:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784650.763651:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728019200 00000100:00100000:0.0:1787784650.763669:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728019200 00000100:00100000:0.0:1787784650.763747:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:0.0:1787784650.763760:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2404:x1874627728019200:12345-192.168.202.41@tcp:8:bash.0 00010000:00080000:0.0:1787784650.763968:0:8916:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:0.0:1787784650.764019:0:8916:0:(genops.c:1385:class_connect()) connect: client 2e90d38f-8956-47bc-80da-c902c22ae09c, cookie 0x88ace7295d9d137 00002000:00100000:0.0:1787784650.764038:0:8916:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2e90d38f-8956-47bc-80da-c902c22ae09c/ffff8951c2ce2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784650.764067:0:8916:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787784650.764197:0:8916:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787784650.764247:0:8916:0:(import.c:65:import_set_state_nolock()) ffff8951c2ce6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784650.764355:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2404:x1874627728019200:12345-192.168.202.41@tcp:8:bash.0 Request processed in 595us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784650.764364:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:1.0:1787784650.770852:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784650.771929:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728019328 00000100:00100000:2.0:1787784650.771943:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728019328 00000100:00100000:2.0:1787784650.772030:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:2.0:1787784650.772043:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbf0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:0:x1874627728019328:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784650.772062:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784650.772099:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003482a36a/0x88ace7295d9d13e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e729eb expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784650.772301:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784650.772325:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=391s v=(0 0) 00010000:00010000:2.0:1787784650.772330:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784650.772341:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003482a36a/0x88ace7295d9d13e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729eb expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.772365:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003482a36a/0x88ace7295d9d13e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729eb expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784650.772379:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c13ff000, rc 0) 00000100:00100000:2.0:1787784650.772555:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbf0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:0:x1874627728019328:12345-192.168.202.41@tcp:101:bash.0 Request processed in 515us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784650.772563:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00080000:3.0:1787784650.773710:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784650.781875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784650.781967:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728019456 00000100:00100000:0.0:1787784650.781983:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728019456 00000100:00100000:0.0:1787784650.782101:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:0.0:1787784650.782114:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:11151:x1874627728019456:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1787784650.782139:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784650.782166:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e729f2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.782204:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003482a36a/0x88ace7295d9d13e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729eb expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.782215:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784650.782219:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784650.782225:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.782521:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003482a36a/0x88ace7295d9d13e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729eb expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.782539:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003482a36a/0x88ace7295d9d13e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729eb expref: 8 pid: 8436 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784650.782556:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1874627750135424:192.168.202.41@tcp:104: 00000100:00100000:0.0:1787784650.782703:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784650.791342:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784650.791857:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728019584 00000100:00100000:3.0:1787784650.791869:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728019584 00010000:00010000:3.0:1787784650.791924:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003482a36a/0x88ace7295d9d13e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729eb expref: 9 pid: 8436 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784650.791972:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:3.0:1787784650.791985:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2406:x1874627728019584:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784650.792023:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784650.792047:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003482a36a/0x88ace7295d9d13e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729eb expref: 9 pid: 8436 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.792062:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003482a36a/0x88ace7295d9d13e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729eb expref: 9 pid: 8436 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.792092:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784650.792097:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784650.792106:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.792129:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784650.792168:0:8452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784650.792183:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8452:1874627750135552:192.168.202.41@tcp:105: 00000100:00100000:3.0:1787784650.792285:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951ebbec780 going to sleep for 11 seconds 00010000:00010000:0.0:1787784650.792837:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003482a36a/0x88ace7295d9d13e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729eb expref: 9 pid: 8436 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784650.792857:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1874627750135424:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784650.792890:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.792903:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629c00, rc 0) 00000100:00100000:0.0:1787784650.792945:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+8:11151:x1874627728019456:12345-192.168.202.41@tcp:101:bash.0 Request processed in 10834us (11081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784650.792953:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:3.0:1787784650.798059:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8452:1874627750135552:192.168.202.41@tcp:105: 00010000:00010000:3.0:1787784650.798091:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784650.798161:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2406:x1874627728019584:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 6177us (6827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784650.798173:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:3.0:1787784650.809610:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784650.809970:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728019840 00000100:00100000:1.0:1787784650.809981:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728019840 00000100:00100000:1.0:1787784650.810077:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:1.0:1787784650.810089:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+15:11151:x1874627728019840:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:1.0:1787784650.810518:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+16:11151:x1874627728019840:12345-192.168.202.41@tcp:35:bash.0 Request processed in 430us (917us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787784650.810528:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:1.0:1787784650.913982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784650.914077:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728020096 00000100:00100000:0.0:1787784650.914087:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728020096 00000100:00100000:0.0:1787784650.914152:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:0.0:1787784650.914163:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+16:11161:x1874627728020096:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784650.914186:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784650.914207:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d14c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e729f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784650.914304:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787784650.914424:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d14c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f9 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.914438:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128300) 00010000:00010000:0.0:1787784650.914441:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784650.914446:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d14c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f9 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.914460:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628c00, rc 0) 00000100:00100000:0.0:1787784650.914528:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+17:11161:x1874627728020096:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 367us (556us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1787784650.914552:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:2.0:1787784650.919683:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784650.920111:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728020352 00000100:00100000:0.0:1787784650.920186:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728020352 00000100:00100000:0.0:1787784650.920546:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1787784650.920560:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+17:11161:x1874627728020352:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:0.0:1787784650.921530:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+18:11161:x1874627728020352:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 381us (1269us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787784650.921543:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1787784650.997040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784650.997140:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728020480 00000100:00100000:0.0:1787784650.997152:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728020480 00000100:00100000:0.0:1787784650.997233:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:0.0:1787784650.997246:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+18:11167:x1874627728020480:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784650.997278:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784650.997306:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d15a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a00 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.997406:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d161 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.997424:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d161 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.997440:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d161 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784650.997693:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787784650.997706:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784650.997758:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d161 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.997846:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d15a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a00 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.997870:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d161 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a00 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784650.997882:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:0.0:1787784650.997885:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784650.997890:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629000, rc 0) 00000100:00100000:2.0:1787784651.001137:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+19:11167:x1874627728020480:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 3876us (4105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784651.001174:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:2.0:1787784651.006657:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784651.009812:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728020736 00000100:00100000:0.0:1787784651.009833:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728020736 00000100:00100000:0.0:1787784651.009989:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:0.0:1787784651.010003:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+19:11167:x1874627728020736:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784651.010044:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784651.010073:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d168 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a07 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.010221:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d16f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.010239:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d16f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.010253:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d16f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784651.010267:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787784651.010446:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d168 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a07 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.010470:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d16f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a07 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.010479:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128b00) 00010000:00010000:0.0:1787784651.010482:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784651.010486:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628400, rc 0) 00000100:00100000:0.0:1787784651.010600:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+21:11167:x1874627728020736:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 599us (3956us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787784651.010609:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:2.0:1787784651.014194:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784651.017761:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784651.017856:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728021120 00000100:00100000:2.0:1787784651.017868:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728021120 00000100:00100000:2.0:1787784651.018106:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:2.0:1787784651.018119:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfebd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+21:2406:x1874627728021120:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784651.018141:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784651.018178:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d16f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a07 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.018216:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128b00) 00010000:00010000:2.0:1787784651.018238:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784651.018311:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfebd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+20:2406:x1874627728021120:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 194us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784651.018321:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:1.0:1787784651.019623:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728020992 00000100:00100000:1.0:1787784651.019638:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728020992 00000100:00100000:1.0:1787784651.019812:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:1.0:1787784651.019823:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+20:11167:x1874627728020992:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787784651.019853:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784651.019876:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d17d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a0e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.020048:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d184 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.020191:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d184 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.020204:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d184 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784651.020219:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787784651.020417:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d17d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a0e expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.020438:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d184 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a0e expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.020448:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128b00) 00010000:00010000:1.0:1787784651.020452:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787784651.020455:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602400, rc 0) 00000100:00100000:1.0:1787784651.020611:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11167:x1874627728020992:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 788us (6432us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787784651.020619:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:2.0:1787784651.026959:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784651.027045:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728021248 00000100:00100000:1.0:1787784651.027058:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728021248 00000100:00100000:1.0:1787784651.027125:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:1.0:1787784651.027137:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728021248:12345-192.168.202.41@tcp:1:lfs.0 00010000:00010000:1.0:1787784651.027215:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.027269:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.027278:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784651.027284:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787784651.027291:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.027339:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.027355:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 7 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784651.027374:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1874627750135680:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784651.027514:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2e7acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784651.034072:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1874627750135680:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784651.034084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00010000:00010000:1.0:1787784651.034129:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784651.034352:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728021376 00000100:00100000:3.0:1787784651.034364:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728021376 00002000:00100000:3.0:1787784651.034436:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8951cffcbc00 x1874627728021376/t0(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:532/0 lens 504/0 e 0 to 0 dl 1787784662 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787784651.034448:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8951cffcbc00 with x1874627728021376 ext(0->12) 00010000:00010000:3.0:1787784651.034458:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 8 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.034476:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 8 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784651.034484:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8951cffcbc00 00000100:00100000:3.0:1787784651.034597:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:3.0:1787784651.034609:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2406:x1874627728021376:12345-192.168.202.41@tcp:4:lfs.0 00000001:00100000:2.0:1787784651.047442:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00000100:00100000:0.0:1787784651.050528:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2406:x1874627728021376:12345-192.168.202.41@tcp:4:lfs.0 Request processed in 15911us (16450us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787784651.050549:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00002000:00100000:0.0:1787784651.050563:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8951cffcbc00 x1874627728021376/t4294967300(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:532/0 lens 504/448 e 0 to 0 dl 1787784662 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784651.050585:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8951cffcbc00 with x1874627728021376 ext(0->12) 00010000:00010000:0.0:1787784651.050598:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 9 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.050619:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 9 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784651.050627:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8951cffcbc00 00000100:00100000:3.0:1787784651.060426:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784651.060550:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728021504 00000100:00100000:2.0:1787784651.060559:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728021504 00010000:00010000:2.0:1787784651.060613:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 9 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784651.060661:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:2.0:1787784651.060686:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2660f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2408:x1874627728021504:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784651.060704:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787784651.060724:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787784651.060727:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787784650 00002000:00010000:2.0:1787784651.060729:0:6505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787784650 00002000:00010000:2.0:1787784651.060731:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787784650 00002000:00010000:2.0:1787784651.060733:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787784651.060751:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 9 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.060764:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 9 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.060839:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9d145 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729f2 expref: 9 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.060854:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784651.060859:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784651.060865:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.060874:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.060909:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784651.060966:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784651.060975:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2660f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2408:x1874627728021504:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 290us (557us total) trans 0 rc 0/0 00010000:00010000:1.0:1787784651.060983:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784651.060998:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00010000:00010000:1.0:1787784651.061020:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.061030:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.061038:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.061044:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784651.061049:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.061058:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.061074:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.061082:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc05afbe/0x88ace7295d9d192 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784651.061135:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728021248:12345-192.168.202.41@tcp:1:lfs.0 Request processed in 34000us (34194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784651.061144:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:2.0:1787784651.073077:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784651.073521:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728021760 00000100:00100000:1.0:1787784651.073532:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728021760 00000100:00100000:1.0:1787784651.073606:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:1.0:1787784651.073617:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff455a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11167:x1874627728021760:12345-192.168.202.41@tcp:35:lfs.0 00000004:00010000:1.0:1787784651.073681:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d184 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a0e expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784651.073945:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1787784651.073996:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787784651.074301:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1787784651.074342:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.074358:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d129 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729e4 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.074368:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.074405:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729e4 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.074419:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d129 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729e4 expref: 26 pid: 6522 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784651.074434:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4db480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874627750135808:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784651.074544:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f527a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784651.077838:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4db480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874627750135808:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784651.077871:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784651.078722:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784651.078883:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728021888 00000100:00100000:1.0:1787784651.078891:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728021888 00010000:00010000:1.0:1787784651.078925:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d129 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729e4 expref: 27 pid: 6522 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784651.078968:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:1.0:1787784651.078978:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4561c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+27:2406:x1874627728021888:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784651.078992:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784651.078998:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d129 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729e4 expref: 27 pid: 6522 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.079011:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729e4 expref: 27 pid: 6522 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.079043:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d129 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729e4 expref: 27 pid: 6522 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.079060:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128b00) 00010000:00010000:1.0:1787784651.079065:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.079073:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.079080:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.079110:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784651.079167:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4561c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+26:2406:x1874627728021888:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 190us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784651.079175:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 60 00010000:00010000:0.0:1787784651.079295:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.079314:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784651.079428:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1787784651.079539:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1787784651.079651:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874627750135936:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787784651.079697:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784651.079730:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784651.079872:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750135936 00000100:00100000:1.0:1787784651.079877:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750135936 00000100:00100000:1.0:1787784651.079929:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787784651.079938:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874627750135936:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1787784651.080085:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784651.080269:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874627750135936:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784651.080279:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787784651.080363:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874627750135936:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787784651.080504:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1787784651.080547:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874627750136064:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787784651.080595:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784651.080665:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784651.082642:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750136064 00000100:00100000:2.0:1787784651.082657:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750136064 00000100:00100000:2.0:1787784651.082761:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787784651.082794:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874627750136064:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787784651.082977:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1874627750136064:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 186us (2380us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787784651.082985:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787784651.083075:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874627750136064:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787784651.083149:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1787784651.083195:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.083206:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.083213:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.083220:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784651.083224:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.083250:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.083264:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128b00) 00010000:00010000:0.0:1787784651.083267:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787784651.083273:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.083280:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d199 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787784651.083385:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787784651.083444:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787784651.083456:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391332686951ns, next at 392332684572ns, rc = 0 00000001:00080000:0.0:1787784651.083461:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1787784651.083482:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128b00) 00010000:00010000:0.0:1787784651.083485:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787784651.083491:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d184 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a0e expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784651.083606:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff455a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+29:11167:x1874627728021760:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 9991us (10540us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1787784651.083614:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000020:00080000:0.0:1787784651.083618:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787784651.087383:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784651.087469:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728022016 00000100:00100000:0.0:1787784651.087481:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728022016 00000100:00100000:0.0:1787784651.087542:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:0.0:1787784651.087552:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff472d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+29:11167:x1874627728022016:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784651.087603:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784651.087627:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d1a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a15 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.087682:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d1a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a15 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.087696:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d1a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a15 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.087714:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:0.0:1787784651.087717:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784651.087721:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628c00, rc 0) 00000100:00100000:0.0:1787784651.087884:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff472d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+30:11167:x1874627728022016:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 332us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784651.087891:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:3.0:1787784651.090748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784651.090917:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728022272 00000100:00100000:0.0:1787784651.090930:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728022272 00000100:00100000:0.0:1787784651.091053:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:0.0:1787784651.091064:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f0040450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+30:11167:x1874627728022272:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:0.0:1787784651.091321:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f0040450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+31:11167:x1874627728022272:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 258us (581us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787784651.091330:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:3.0:1787784651.229394:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784651.229508:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728022528 00000100:00100000:0.0:1787784651.229518:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728022528 00000100:00100000:0.0:1787784651.229594:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:0.0:1787784651.229605:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2661a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+31:11177:x1874627728022528:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784651.229646:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784651.229669:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784651.229828:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787784651.229930:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a1c expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.229944:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128300) 00010000:00010000:0.0:1787784651.229948:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784651.229952:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a1c expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.229970:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629c00, rc 0) 00000100:00100000:0.0:1787784651.230042:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2661a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+32:11177:x1874627728022528:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 439us (659us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1787784651.230050:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:1.0:1787784651.235462:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784651.235593:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728022656 00000100:00100000:3.0:1787784651.235603:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728022656 00000100:00100000:3.0:1787784651.235661:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:3.0:1787784651.235672:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+32:11177:x1874627728022656:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:3.0:1787784651.235751:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d1b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.235794:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d1b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.235822:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d1b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.235836:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.235843:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.235850:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.235929:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d1c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.235939:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.235946:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784651.236070:0:7991:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236084:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d1b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236091:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d1b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236099:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d1b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236114:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784651.236119:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d1b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236128:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d1b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236140:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:3.0:1787784651.236144:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784651.236148:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d1b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236155:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d1b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236168:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236175:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236181:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236186:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784651.236189:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236195:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236212:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8951f5128e00) 00010000:00010000:3.0:1787784651.236214:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784651.236218:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236224:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236234:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236240:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d1c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236246:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236252:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784651.236255:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236261:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d1c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236268:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:3.0:1787784651.236271:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784651.236274:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d1c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.236280:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d1c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784651.236370:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+32:11177:x1874627728022656:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 699us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784651.236379:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:3.0:1787784651.240177:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784651.240380:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728022912 00000100:00100000:2.0:1787784651.240390:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728022912 00000100:00100000:2.0:1787784651.240457:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:2.0:1787784651.240467:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+32:11177:x1874627728022912:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1787784651.240726:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+33:11177:x1874627728022912:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 260us (556us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787784651.240736:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00010000:00010000:2.0:1787784651.270069:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784651.295135:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784651.295948:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728023168 00000100:00100000:0.0:1787784651.295960:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728023168 00000100:00100000:0.0:1787784651.296034:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:0.0:1787784651.296044:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff472940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+33:11180:x1874627728023168:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784651.296069:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784651.296088:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a23 expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.296160:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d1d1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.296192:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.296204:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.296217:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d1d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.296235:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.296242:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.296347:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d1df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.296355:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d1df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.296362:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d1df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784651.296373:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787784651.297135:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297146:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d1d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297155:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d1d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297173:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784651.297177:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d1d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297186:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d1d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297200:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:0.0:1787784651.297203:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784651.297207:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d1d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297214:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d1d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297241:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297248:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d1d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297255:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297434:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784651.297504:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297513:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d1d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297533:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8951f5128e00) 00010000:00010000:0.0:1787784651.297536:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784651.297540:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d1d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297546:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d1d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297610:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a23 expref: 36 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297626:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d1df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a23 expref: 35 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.297634:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:0.0:1787784651.297636:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784651.297639:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c13ff000, rc 0) 00000100:00100000:0.0:1787784651.297713:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff472940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+35:11180:x1874627728023168:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1670us (2588us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787784651.297722:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:1.0:1787784651.312894:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784651.313031:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728023296 00000100:00100000:0.0:1787784651.313039:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728023296 00000100:00100000:0.0:1787784651.313098:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:0.0:1787784651.313107:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+35:11180:x1874627728023296:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:0.0:1787784651.313168:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.313184:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.313207:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.313250:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.313257:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.313264:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.313270:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784651.313274:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.313280:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.313291:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:0.0:1787784651.313294:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784651.313298:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784651.313304:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d1ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784651.313376:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+35:11180:x1874627728023296:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 269us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784651.313383:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:3.0:1787784651.320431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784651.328365:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728023552 00000100:00100000:2.0:1787784651.328379:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728023552 00000100:00100000:2.0:1787784651.328587:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:2.0:1787784651.328601:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+35:11180:x1874627728023552:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1787784651.328889:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+36:11180:x1874627728023552:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 291us (8466us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787784651.328918:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:1.0:1787784651.662098:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784651.662205:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728023808 00000100:00100000:3.0:1787784651.662215:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728023808 00000100:00100000:3.0:1787784651.662284:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:3.0:1787784651.662296:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+36:11212:x1874627728023808:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:3.0:1787784651.662330:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784651.662361:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d1f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a2a expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.662477:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.662493:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.662506:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784651.662517:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787784651.662669:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d1f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a2a expref: 39 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.662687:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a2a expref: 38 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784651.662712:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:3.0:1787784651.662715:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784651.662718:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713200, rc 0) 00000100:00100000:3.0:1787784651.662830:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+38:11212:x1874627728023808:12345-192.168.202.41@tcp:101:cat.0 Request processed in 536us (742us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787784651.662838:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:1.0:1787784651.682640:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784651.682696:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784651.682823:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728023936 00000100:00100000:2.0:1787784651.682832:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728023936 00000100:00100000:2.0:1787784651.682903:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:2.0:1787784651.682914:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+38:2408:x1874627728023936:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784651.682930:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784651.682955:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9d1fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a2a expref: 38 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.682973:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:2.0:1787784651.682978:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784651.683032:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+37:2408:x1874627728023936:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 120us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784651.683040:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:0.0:1787784651.683122:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728024192 00000100:00100000:0.0:1787784651.683139:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728024192 00000100:00100000:0.0:1787784651.683174:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:0.0:1787784651.683182:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+37:11212:x1874627728024192:12345-192.168.202.41@tcp:35:cat.0 00000100:00100000:0.0:1787784651.683400:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+38:11212:x1874627728024192:12345-192.168.202.41@tcp:35:cat.0 Request processed in 218us (703us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1787784651.683407:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:0.0:1787784651.820751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784651.820877:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728024448 00000100:00100000:2.0:1787784651.820887:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728024448 00000100:00100000:2.0:1787784651.820954:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:2.0:1787784651.820964:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+38:11218:x1874627728024448:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:2.0:1787784651.820988:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784651.820991:0:11332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787784651.821018:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d161 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a00 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.821039:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784651.821044:0:11332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784651.821058:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d209 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a31 expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.821184:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.821198:0:11332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d1df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a23 expref: 38 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.821206:0:11332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.821237:0:11332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d1df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a23 expref: 38 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.821250:0:11332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d1df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a23 expref: 38 pid: 11332 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784651.821264:0:11332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff470f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750136192:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784651.821366:0:11332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d89396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784651.824797:0:11332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff470f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750136192:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784651.824831:0:11332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784651.832757:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784651.835878:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728024576 00000100:00100000:1.0:1787784651.835893:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728024576 00010000:00010000:1.0:1787784651.835945:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d1df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a23 expref: 39 pid: 11332 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784651.836001:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:1.0:1787784651.836011:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+39:2406:x1874627728024576:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784651.836026:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784651.836034:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d1df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a23 expref: 39 pid: 11332 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.836047:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d1df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a23 expref: 39 pid: 11332 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.836087:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff000/0x88ace7295d9d1df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a23 expref: 39 pid: 11332 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.836107:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:1.0:1787784651.836114:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.836123:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.836131:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784651.836216:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784651.836290:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+38:2406:x1874627728024576:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 280us (3543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784651.836299:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00010000:00010000:2.0:1787784651.841744:0:11332:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.841761:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784651.841849:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787784651.842042:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d209 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a31 expref: 39 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.842065:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a31 expref: 38 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.842075:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:2.0:1787784651.842079:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787784651.842083:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5be00, rc 0) 00000100:00100000:2.0:1787784651.842348:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+38:11218:x1874627728024448:12345-192.168.202.41@tcp:101:dd.0 Request processed in 21384us (21605us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787784651.842358:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:0.0:1787784651.855060:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784651.855137:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728024704 00000100:00100000:2.0:1787784651.855146:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728024704 00000100:00100000:2.0:1787784651.855209:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:2.0:1787784651.855220:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+38:11218:x1874627728024704:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:2.0:1787784651.855245:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784651.855266:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d21e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a38 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.855303:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d225 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.855317:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d225 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.855329:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d225 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.855964:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d21e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a38 expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.855984:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d225 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a38 expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.855994:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:2.0:1787784651.855997:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787784651.856000:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5b400, rc 0) 00000100:00100000:2.0:1787784651.856101:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+39:11218:x1874627728024704:12345-192.168.202.41@tcp:101:dd.0 Request processed in 882us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784651.856110:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:0.0:1787784651.866809:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784651.869204:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728024960 00000100:00100000:2.0:1787784651.869218:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728024960 00000100:00100000:2.0:1787784651.869348:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:2.0:1787784651.869360:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+39:11218:x1874627728024960:12345-192.168.202.41@tcp:36:dd.0 00010000:00010000:2.0:1787784651.869687:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d22c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.869711:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d22c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.869724:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d22c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784651.869942:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1787784651.869972:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1a38736 reply state 0000000017c69639 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d22c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.870004:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d22c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784651.870012:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:2.0:1787784651.870015:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784651.870019:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784651.870127:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+42:11218:x1874627728024960:12345-192.168.202.41@tcp:36:dd.0 Request processed in 768us (3328us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1787784651.870136:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00000020:00080000:2.0:1787784651.870141:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787784652.061840:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784652.061904:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784652.061934:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784652.061964:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784652.061997:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728025600 00000100:00100000:3.0:1787784652.062007:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728025600 00000100:00100000:1.0:1787784652.062027:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728025216 00000100:00100000:1.0:1787784652.062033:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728025216 00000100:00100000:3.0:1787784652.062069:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 302 00000100:00100000:1.0:1787784652.062078:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 303 00000100:00100000:3.0:1787784652.062087:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728025600:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784652.062091:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2661680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728025216:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784652.062193:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728025344 00000100:00100000:2.0:1787784652.062197:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728025344 00000100:00100000:2.0:1787784652.062231:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:2.0:1787784652.062239:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2662940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2408:x1874627728025344:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784652.062297:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2661680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728025216:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 210us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784652.062305:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 303 00000100:00100000:1.0:1787784652.062357:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728025088 00000100:00100000:1.0:1787784652.062362:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728025088 00000100:00100000:1.0:1787784652.062396:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 414 00000100:00100000:1.0:1787784652.062427:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728025088:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784652.066369:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728025600:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 4275us (4416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784652.066386:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 302 00000100:00080000:3.0:1787784652.066439:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787784652.066448:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784652.069157:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2662940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2408:x1874627728025344:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 6906us (7239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784652.069174:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:0.0:1787784652.076315:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784652.076378:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728025472 00000100:00100000:2.0:1787784652.076390:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728025472 00000100:00100000:2.0:1787784652.076482:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 304 00000100:00100000:2.0:1787784652.076495:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728025472:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784652.076590:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728025472:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 98us (283us total) trans 0 rc 0/0 00000100:00080000:3.0:1787784652.076595:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784652.076600:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 304 00000100:00100000:1.0:1787784652.083709:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728025088:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 21269us (21865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784652.083724:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 414 00000040:00080000:2.0:1787784652.104848:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784652.294818:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784652.309230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784652.309465:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728025728 00000100:00100000:1.0:1787784652.309475:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728025728 00000100:00100000:1.0:1787784652.309829:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:1.0:1787784652.309841:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+42:11232:x1874627728025728:12345-192.168.202.41@tcp:101:stat.0 00010000:00010000:1.0:1787784652.309865:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784652.309895:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d233 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a3f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.309968:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d23a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.309983:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d23a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.309995:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d23a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.310008:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d241 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.310016:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.310023:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.310112:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d248 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.310194:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a31 expref: 43 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.310204:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d248 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.310337:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a31 expref: 43 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.310353:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a31 expref: 43 pid: 11332 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784652.310368:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874627750136320:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784652.310464:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f527a000 going to sleep for 11 seconds 00000100:00080000:3.0:1787784652.310696:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784652.313094:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874627750136320:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784652.313136:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d248 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784652.314068:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784652.314378:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728025984 00000100:00100000:3.0:1787784652.314387:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728025984 00000100:00100000:3.0:1787784652.314463:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:3.0:1787784652.314475:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+44:6178:x1874627728025984:12345-192.168.202.41@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787784652.314882:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+45:6178:x1874627728025984:12345-192.168.202.41@tcp:35:ldlm_bl.0 Request processed in 408us (816us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787784652.315386:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:2.0:1787784652.319675:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784652.319801:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728026112 00000100:00100000:3.0:1787784652.319810:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728026112 00010000:00010000:3.0:1787784652.319858:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a31 expref: 45 pid: 11332 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784652.319908:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:3.0:1787784652.319919:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff470f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+45:2405:x1874627728026112:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784652.319934:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784652.319940:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a31 expref: 45 pid: 11332 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.319954:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a31 expref: 45 pid: 11332 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.319987:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d210 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a31 expref: 45 pid: 11332 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.320006:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:3.0:1787784652.320011:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d248 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.320021:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d248 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.320028:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d248 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.320069:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784652.320119:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff470f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+44:2405:x1874627728026112:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 201us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784652.320127:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00010000:00010000:0.0:1787784652.320539:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d248 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.320548:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d248 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784652.320611:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787784652.320616:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784652.320669:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d248 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.320683:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d248 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.320692:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d23a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.320723:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d23a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.320731:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d23a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.320738:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784652.320742:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d23a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.320751:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d23a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.320762:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:0.0:1787784652.320789:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784652.320795:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d23a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.320801:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d23a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.321099:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.321107:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d241 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.321114:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.321129:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784652.321139:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.321146:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d241 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.321156:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8951f5128e00) 00010000:00010000:0.0:1787784652.321159:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784652.321162:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d241 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.321169:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d241 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.321204:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d233 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a3f expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.321218:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d248 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a3f expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.321226:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:0.0:1787784652.321229:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784652.321231:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602c00, rc 0) 00000100:00100000:0.0:1787784652.321286:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+43:11232:x1874627728025728:12345-192.168.202.41@tcp:101:stat.0 Request processed in 11447us (12065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784652.321294:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:2.0:1787784652.458325:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784652.458406:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728026368 00000100:00100000:3.0:1787784652.458415:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728026368 00000100:00100000:3.0:1787784652.458486:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:3.0:1787784652.458497:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+43:11238:x1874627728026368:12345-192.168.202.41@tcp:36:truncate.0 00010000:00010000:3.0:1787784652.458582:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784652.458610:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d248 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a3f expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.458630:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:3.0:1787784652.458634:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784652.458852:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d24f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.458867:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d24f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.458877:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d24f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787784652.459163:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1787784652.459189:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f227b7d7 reply state 00000000e4853408 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d24f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.459202:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d24f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.459222:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:3.0:1787784652.459225:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787784652.459228:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787784652.459423:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+45:11238:x1874627728026368:12345-192.168.202.41@tcp:36:truncate.0 Request processed in 926us (1107us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787784652.459439:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00000020:00080000:3.0:1787784652.459445:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787784652.768877:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784652.768983:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728026496 00000100:00100000:0.0:1787784652.768992:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728026496 00000100:00100000:0.0:1787784652.769054:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:0.0:1787784652.769065:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+45:11252:x1874627728026496:12345-192.168.202.41@tcp:101:stat.0 00010000:00010000:0.0:1787784652.769100:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784652.769120:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d256 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a46 expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769181:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d25d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769196:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d25d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769222:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d25d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769235:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d264 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769242:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769249:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769329:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d26b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769339:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d26b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769347:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d26b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784652.769386:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787784652.769397:0:11332:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784652.769416:0:11332:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d26b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769664:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d26b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769675:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d25d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769683:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d25d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769689:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d25d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769696:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784652.769699:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d25d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769708:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d25d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769720:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:0.0:1787784652.769722:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784652.769726:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d25d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769732:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d25d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769746:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769761:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d264 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769809:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769816:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784652.769819:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769826:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d264 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769833:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8951f5128e00) 00010000:00010000:0.0:1787784652.769835:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784652.769838:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d264 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769843:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d264 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769872:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d256 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a46 expref: 47 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769885:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d26b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a46 expref: 46 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.769893:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:0.0:1787784652.769895:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784652.769904:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628400, rc 0) 00000100:00100000:0.0:1787784652.770114:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+46:11252:x1874627728026496:12345-192.168.202.41@tcp:101:stat.0 Request processed in 1050us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784652.770122:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:0.0:1787784652.920873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784652.920979:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728026752 00000100:00100000:1.0:1787784652.920990:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728026752 00000100:00100000:1.0:1787784652.921062:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:1.0:1787784652.921073:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+46:11262:x1874627728026752:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787784652.921095:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784652.921118:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d272 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a4d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784652.921288:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787784652.921408:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d272 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a4d expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.921423:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128300) 00010000:00010000:1.0:1787784652.921426:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787784652.921431:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a4d expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.921447:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603c00, rc 0) 00000100:00100000:1.0:1787784652.921515:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+47:11262:x1874627728026752:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 443us (652us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1787784652.921522:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 66 00000001:00080000:0.0:1787784652.926787:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000004:00080000:0.0:1787784652.926830:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787784652.926854:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8951c4d23600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787784652.926859:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8951f52ec200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8951c4d23300 00000020:00080000:0.0:1787784652.926863:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8951f52ec500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8950c33b6c00 00000020:00080000:2.0:1787784652.926908:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787784652.927101:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1787784652.927233:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff600/0x88ace7295d9d0dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927245:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff600/0x88ace7295d9d0dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927253:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff600/0x88ace7295d9d0dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927258:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c13ff600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784652.927263:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff600/0x88ace7295d9d0dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927271:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff600/0x88ace7295d9d0dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927288:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8951e0a67a00) 00010000:00010000:3.0:1787784652.927291:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784652.927296:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff600/0x88ace7295d9d0dc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927302:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff600/0x88ace7295d9d0dc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927335:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff400/0x88ace7295d9d0e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927341:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff400/0x88ace7295d9d0e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927347:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff400/0x88ace7295d9d0e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927351:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c13ff400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784652.927354:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff400/0x88ace7295d9d0e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927360:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff400/0x88ace7295d9d0e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927366:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:3.0:1787784652.927369:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784652.927371:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff400/0x88ace7295d9d0e3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927376:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c13ff400/0x88ace7295d9d0e3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927392:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927397:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d122 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927402:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927412:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784652.927414:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927420:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d122 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927428:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8951f5128e00) 00010000:00010000:3.0:1787784652.927431:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784652.927434:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d122 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927439:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d122 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927456:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d22c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927462:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d22c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927467:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d22c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927470:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784652.927473:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d22c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927478:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d22c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927494:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:3.0:1787784652.927496:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784652.927498:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d22c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927503:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d22c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927513:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d24f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927519:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d24f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927523:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d24f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927527:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784652.927530:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d24f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927535:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d24f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927541:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:3.0:1787784652.927543:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784652.927546:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d24f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.927581:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d24f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784652.927969:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750136448:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787784652.928035:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784652.928217:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750136448 00000100:00100000:1.0:1787784652.928225:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750136448 00000100:00100000:1.0:1787784652.928277:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787784652.928288:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1874627750136448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787784652.928317:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1787784652.928348:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8f6dca, atime: 0x6a8f6dca, ctime: 0x6a8f6dca, blocks: 0x8 00010000:00010000:1.0:1787784652.928355:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b48edb16/0x88ace7295d9d280 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.928370:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787784652.928375:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784652.928381:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b48edb16/0x88ace7295d9d280 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.928411:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b48edb16/0x88ace7295d9d280 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.928420:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b48edb16/0x88ace7295d9d280 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.928428:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b48edb16/0x88ace7295d9d280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.928447:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787784652.928594:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1874627750136448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 308us (559us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787784652.928602:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1787784652.928622:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784652.928629:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b48edb16/0x88ace7295d9d280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.928638:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784652.928642:0:10397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b48edb16/0x88ace7295d9d280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.928651:0:10397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b48edb16/0x88ace7295d9d280 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.928666:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b48edb16/0x88ace7295d9d280 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.928679:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b48edb16/0x88ace7295d9d280 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.928695:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784652.928697:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784652.928699:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787784652.928923:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8951c12ad680/2, rc 0, transno 4294967302 00000100:00100000:2.0:1787784652.928930:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750136448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787784652.929738:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784652.930064:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728027008 00000100:00100000:0.0:1787784652.930071:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728027008 00000100:00100000:0.0:1787784652.930118:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:0.0:1787784652.930129:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+12:11262:x1874627728027008:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:0.0:1787784652.931407:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+13:11262:x1874627728027008:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 1274us (1666us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1787784652.931421:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:1.0:1787784652.934178:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784652.934200:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750136576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784652.934280:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784652.934337:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750136576 00000100:00100000:1.0:1787784652.934345:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750136576 00000100:00100000:1.0:1787784652.934394:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787784652.934403:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750136576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784652.934542:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784652.934601:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750136576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 198us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784652.934609:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787784652.934662:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750136576:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787784652.934795:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784652.934816:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784652.934825:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750136704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784652.934857:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784652.934889:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750136704 00000100:00100000:3.0:1787784652.934893:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750136704 00000100:00100000:3.0:1787784652.934930:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787784652.934937:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750136704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784652.934948:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784652.934990:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750136704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784652.934996:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1787784652.935011:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784652.935028:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750136704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784652.935928:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784652.935941:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750136832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784652.935997:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784652.937896:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750136832 00000100:00100000:1.0:1787784652.937912:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750136832 00000100:00100000:1.0:1787784652.937991:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787784652.938001:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff455a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750136832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784652.938037:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787784652.938106:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff455a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750136832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784652.938131:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787784652.938356:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750136832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784653.059034:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784653.059391:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728027264 00000100:00100000:2.0:1787784653.059401:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728027264 00000100:00100000:2.0:1787784653.059574:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:2.0:1787784653.059585:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+13:11268:x1874627728027264:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784653.059609:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784653.059631:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d287 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a54 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.059748:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.059820:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d26b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a46 expref: 14 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.059831:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.059863:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d26b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a46 expref: 14 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.059895:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d26b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a46 expref: 14 pid: 11332 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784653.059910:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750136960:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784653.060027:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c11ca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784653.064141:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784653.064238:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728027392 00000100:00100000:0.0:1787784653.064248:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728027392 00010000:00010000:0.0:1787784653.064302:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d26b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a46 expref: 15 pid: 11332 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784653.064367:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:0.0:1787784653.064378:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+15:2406:x1874627728027392:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784653.064394:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784653.064401:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d26b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a46 expref: 15 pid: 11332 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.064414:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d26b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a46 expref: 15 pid: 11332 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.064448:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:0.0:1787784653.064455:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.064465:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.064473:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.064493:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784653.064559:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+15:2406:x1874627728027392:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 174us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.064568:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00010000:00010000:3.0:1787784653.066388:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d26b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a46 expref: 14 pid: 11332 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784653.066417:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750136960:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784653.066508:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784653.066519:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784653.066525:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784653.066569:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787784653.067083:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d287 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a54 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784653.067102:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a54 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784653.067112:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:3.0:1787784653.067115:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787784653.067119:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5b600, rc 0) 00000100:00100000:3.0:1787784653.067187:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+14:11268:x1874627728027264:12345-192.168.202.41@tcp:101:bash.0 Request processed in 7603us (8163us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787784653.067196:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:2.0:1787784653.070533:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784653.070684:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728027648 00000100:00100000:1.0:1787784653.070694:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728027648 00000100:00100000:1.0:1787784653.070787:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:1.0:1787784653.070800:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+14:11268:x1874627728027648:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:1.0:1787784653.071025:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d29c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784653.071045:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d29c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784653.071057:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d29c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784653.071097:0:11332:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1787784653.071116:0:11332:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e77dd822 reply state 0000000019c0c859 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d29c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784653.071129:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d29c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784653.071137:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:1.0:1787784653.071140:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787784653.071143:0:11332:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784653.071236:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+17:11268:x1874627728027648:12345-192.168.202.41@tcp:36:bash.0 Request processed in 439us (712us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1787784653.071245:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00000020:00080000:1.0:1787784653.071249:0:11332:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787784653.077410:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784653.077510:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728027776 00000100:00100000:2.0:1787784653.077519:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728027776 00000100:00100000:2.0:1787784653.077589:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:2.0:1787784653.077600:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+17:11268:x1874627728027776:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784653.077626:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784653.077646:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a5b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.077735:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d2aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.077750:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a54 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.077760:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d2aa lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.077830:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a54 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.077863:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a54 expref: 18 pid: 6523 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784653.077878:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3385a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874627750137088:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784653.077953:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c11ca540 going to sleep for 11 seconds 00000100:00100000:3.0:1787784653.081451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784653.081544:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728027904 00000100:00100000:0.0:1787784653.081564:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728027904 00010000:00010000:0.0:1787784653.081604:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a54 expref: 19 pid: 6523 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784653.081671:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:0.0:1787784653.081683:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+19:2405:x1874627728027904:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784653.081699:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784653.081707:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a54 expref: 19 pid: 6523 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.081719:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a54 expref: 19 pid: 6523 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.081744:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:0.0:1787784653.081749:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d2aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.081801:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.081810:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d2aa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.081829:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784653.081883:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+19:2405:x1874627728027904:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 202us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.081892:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00010000:00010000:2.0:1787784653.082597:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d28e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a54 expref: 18 pid: 6523 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784653.082618:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3385a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874627750137088:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784653.082641:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.082651:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.082656:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784653.082713:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787784653.082718:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787784653.082743:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.082824:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a5b expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.082838:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d2aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a5b expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.082857:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:2.0:1787784653.082860:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784653.082863:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5b800, rc 0) 00000100:00100000:2.0:1787784653.082915:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+17:11268:x1874627728027776:12345-192.168.202.41@tcp:101:bash.0 Request processed in 5317us (5515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784653.082924:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:3.0:1787784653.089742:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784653.090011:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728028160 00000100:00100000:2.0:1787784653.090021:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728028160 00000100:00100000:2.0:1787784653.090079:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:2.0:1787784653.090089:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f0041050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+17:11268:x1874627728028160:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:2.0:1787784653.090332:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f0041050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+18:11268:x1874627728028160:12345-192.168.202.41@tcp:35:bash.0 Request processed in 244us (600us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787784653.090341:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:3.0:1787784653.203400:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784653.203518:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728028416 00000100:00100000:2.0:1787784653.203527:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728028416 00000100:00100000:2.0:1787784653.203617:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:2.0:1787784653.203637:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+18:11278:x1874627728028416:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784653.203664:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784653.203685:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a62 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784653.203838:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787784653.203934:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a62 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.203969:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128300) 00010000:00010000:2.0:1787784653.203972:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784653.203977:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a62 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.203992:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5ba00, rc 0) 00000100:00100000:2.0:1787784653.204052:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+19:11278:x1874627728028416:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 426us (663us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1787784653.204060:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:1.0:1787784653.209375:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784653.209463:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728028544 00000100:00100000:2.0:1787784653.209472:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728028544 00000100:00100000:2.0:1787784653.209527:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:2.0:1787784653.209535:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+19:11278:x1874627728028544:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:2.0:1787784653.209621:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209648:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209660:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209677:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209683:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209699:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209818:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209828:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209834:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784653.209884:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209896:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209903:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209910:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209915:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784653.209919:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209925:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209937:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784653.209945:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784653.209950:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209956:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209969:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209974:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209979:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209983:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ac00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784653.209985:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209990:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.209997:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8951e0a67800) 00010000:00010000:2.0:1787784653.209999:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784653.210001:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.210006:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.210018:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.210029:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.210034:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.210038:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ba00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784653.210040:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.210046:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.210052:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:2.0:1787784653.210054:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784653.210058:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.210063:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784653.210143:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+19:11278:x1874627728028544:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 607us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784653.210150:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:3.0:1787784653.215509:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784653.215599:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728028800 00000100:00100000:2.0:1787784653.215609:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728028800 00000100:00100000:2.0:1787784653.215684:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:2.0:1787784653.215696:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+19:11278:x1874627728028800:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1787784653.215977:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+20:11278:x1874627728028800:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 284us (476us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787784653.215999:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00010000:00010000:2.0:1787784653.318165:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784653.327931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784653.328079:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728029056 00000100:00100000:2.0:1787784653.328089:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728029056 00000100:00100000:2.0:1787784653.328206:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:2.0:1787784653.328218:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+20:11281:x1874627728029056:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784653.328241:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784653.328272:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328346:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2db lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328359:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328370:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328382:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328389:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328396:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328509:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d2e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328537:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328555:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784653.328566:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787784653.328639:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328646:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2db lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328653:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328658:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ac00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784653.328662:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328668:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328680:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784653.328683:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784653.328687:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328694:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d2db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328708:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328720:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328726:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328730:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784653.328733:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328739:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328747:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8951e0a67800) 00010000:00010000:2.0:1787784653.328750:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784653.328753:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328759:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d2e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328843:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d2d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a69 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328855:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a69 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.328861:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:2.0:1787784653.328864:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784653.328871:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a800, rc 0) 00000100:00100000:2.0:1787784653.328936:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11281:x1874627728029056:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 721us (1015us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787784653.328944:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:1.0:1787784653.334662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784653.334757:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784653.335080:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728029184 00000100:00100000:0.0:1787784653.335090:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728029184 00000100:00100000:0.0:1787784653.335149:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:0.0:1787784653.335173:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11281:x1874627728029184:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:0.0:1787784653.335248:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d2f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.335283:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d2f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.335296:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d2f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.335339:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d2f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.335348:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d2f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.335357:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d2f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.335363:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784653.335367:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d2f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.335374:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d2f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.335386:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:0.0:1787784653.335389:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784653.335393:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d2f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.335399:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d2f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784653.335491:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11281:x1874627728029184:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 319us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.335499:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:2.0:1787784653.336098:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728029312 00000100:00100000:2.0:1787784653.336105:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728029312 00000100:00100000:2.0:1787784653.336187:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:2.0:1787784653.336200:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+22:2406:x1874627728029312:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784653.336213:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784653.336230:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d2e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a69 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.336243:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:2.0:1787784653.336247:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784653.336296:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+21:2406:x1874627728029312:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 101us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784653.336304:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:1.0:1787784653.340148:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784653.341064:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728029568 00000100:00100000:2.0:1787784653.341075:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728029568 00000100:00100000:2.0:1787784653.341138:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:2.0:1787784653.341148:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+21:11281:x1874627728029568:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1787784653.341375:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11281:x1874627728029568:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 228us (1239us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787784653.341385:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:0.0:1787784653.446129:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff470f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750137600:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.446197:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784653.446266:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750138112:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.446284:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784653.446306:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787784653.446312:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750137216:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.446334:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784653.446352:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750137728:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.446368:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784653.446379:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750138240:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.446396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784653.446417:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750137344:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.446447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784653.446461:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1219a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750137856:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.446478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784653.446492:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787784653.446496:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750137472:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.446514:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784653.446526:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1218780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750137984:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.446540:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784653.446597:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750137216 00000100:00100000:0.0:1787784653.446603:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750137216 00000100:00100000:0.0:1787784653.446654:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1787784653.446663:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750137216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.446714:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750137216:12345-0@lo:400:kworker.0 Request processed in 52us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.446721:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1787784653.446752:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750138240 00000100:00100000:0.0:1787784653.446755:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750138240 00000100:00100000:0.0:1787784653.446812:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787784653.446818:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff476d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750138240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.446848:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff476d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750138240:12345-0@lo:400:kworker.0 Request processed in 31us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.446854:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787784653.446886:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750137216:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.446899:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750138240:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.446921:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750137600 00000100:00100000:0.0:1787784653.446924:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750137600 00000100:00100000:0.0:1787784653.446940:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750138112 00000100:00100000:0.0:1787784653.446942:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750138112 00000100:00100000:0.0:1787784653.446952:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750137728 00000100:00100000:0.0:1787784653.446955:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750137728 00000100:00100000:0.0:1787784653.446964:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750137344 00000100:00100000:0.0:1787784653.446966:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750137344 00000100:00100000:0.0:1787784653.446973:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750137856 00000100:00100000:0.0:1787784653.446975:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750137856 00000100:00100000:0.0:1787784653.446984:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750137984 00000100:00100000:0.0:1787784653.446986:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750137984 00000100:00100000:0.0:1787784653.446996:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787784653.447008:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750137600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.447039:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750137600:12345-0@lo:400:kworker.0 Request processed in 33us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.447044:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787784653.447055:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787784653.447061:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750138112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.447081:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750138112:12345-0@lo:400:kworker.0 Request processed in 20us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.447085:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787784653.447108:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787784653.447113:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750137728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.447134:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750137728:12345-0@lo:400:kworker.0 Request processed in 22us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.447138:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787784653.447147:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787784653.447151:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff476940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750137344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.447173:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff476940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750137344:12345-0@lo:400:kworker.0 Request processed in 22us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.447178:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787784653.447187:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787784653.447191:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750137856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.447211:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750137856:12345-0@lo:400:kworker.0 Request processed in 20us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.447215:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787784653.447223:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787784653.447234:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750137984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.447256:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750137984:12345-0@lo:400:kworker.0 Request processed in 23us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.447260:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787784653.447284:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1218780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750137984:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.447293:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750137344:0@lo:400:kworker.0 00010000:00080000:0.0:1787784653.447304:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c1219a40 x1874627750137856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784653.447313:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1219a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750137856:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.447338:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750137728:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.447348:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff470f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750137600:0@lo:400:kworker.0 00010000:00080000:0.0:1787784653.447357:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f534fc00 x1874627750138112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784653.447364:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750138112:0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.447406:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750137472 00000100:00100000:0.0:1787784653.447410:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750137472 00000100:00100000:0.0:1787784653.447432:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787784653.447438:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750137472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784653.447477:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750137472:12345-0@lo:400:kworker.0 Request processed in 39us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.447481:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787784653.447500:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750137472:0@lo:400:kworker.0 00000100:00080000:3.0:1787784653.447856:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784653.447861:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784653.447864:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784653.447930:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784653.447942:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750138368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784653.447989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784653.448595:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750138368 00000100:00100000:3.0:1787784653.448601:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750138368 00000100:00100000:3.0:1787784653.448653:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787784653.448662:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750138368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787784653.448690:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787784653.448734:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750138368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784653.448748:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787784653.448866:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750138368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784653.450951:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784653.450978:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750138496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784653.451047:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784653.451556:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750138496 00000100:00100000:3.0:1787784653.451564:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750138496 00000100:00100000:3.0:1787784653.451648:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787784653.451659:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874627750138496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784653.451686:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787784653.451751:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874627750138496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784653.451758:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787784653.451884:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750138496:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787784653.452445:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784653.597122:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784653.597349:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728029824 00000100:00100000:0.0:1787784653.597359:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728029824 00000100:00100000:0.0:1787784653.597436:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 74 00000100:00100000:0.0:1787784653.597449:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11299:x1874627728029824:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:0.0:1787784653.597476:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784653.597499:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d2fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a70 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.597650:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d305 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.597667:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d305 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.597679:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d305 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784653.597690:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787784653.598008:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d2fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a70 expref: 25 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.598027:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d305 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a70 expref: 24 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.598036:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:0.0:1787784653.598039:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787784653.598042:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629c00, rc 0) 00000100:00100000:0.0:1787784653.598156:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+24:11299:x1874627728029824:12345-192.168.202.41@tcp:101:cat.0 Request processed in 709us (1045us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1787784653.598179:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 74 00000100:00100000:1.0:1787784653.671509:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784653.675355:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728029952 00000100:00100000:0.0:1787784653.675370:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728029952 00000100:00100000:0.0:1787784653.675591:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00100000:0.0:1787784653.675602:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+24:11300:x1874627728029952:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784653.675636:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784653.675659:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a77 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.675729:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d31a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.675744:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d31a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.675782:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d31a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784653.675829:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787784653.675833:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784653.675855:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d31a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.675892:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a77 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.675913:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d31a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a77 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.675941:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:0.0:1787784653.675945:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784653.675949:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628400, rc 0) 00000100:00100000:0.0:1787784653.676033:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+25:11300:x1874627728029952:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 432us (4533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.676040:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00100000:1.0:1787784653.687329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784653.694604:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728030336 00000100:00100000:0.0:1787784653.694622:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728030336 00000100:00100000:1.0:1787784653.695076:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:1.0:1787784653.695087:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+25:11300:x1874627728030336:12345-192.168.202.41@tcp:35:lfs.0 00000001:00080000:1.0:1787784653.695470:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967352 00000100:00100000:1.0:1787784653.695642:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+27:11300:x1874627728030336:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 555us (8321us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787784653.695650:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000020:00080000:1.0:1787784653.695655:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787784653.712903:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784653.713016:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728030464 00000100:00100000:0.0:1787784653.713027:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728030464 00000100:00100000:0.0:1787784653.713095:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:0.0:1787784653.713106:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+27:11300:x1874627728030464:12345-192.168.202.41@tcp:103:lfs.0 00010000:00010000:0.0:1787784653.713121:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787784653.713146:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d2aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a5b expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.713172:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d305 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a70 expref: 26 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.713187:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d1a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a15 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.713198:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:0.0:1787784653.713212:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784653.713271:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+24:11300:x1874627728030464:12345-192.168.202.41@tcp:103:lfs.0 Request processed in 167us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.713298:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:3.0:1787784653.718463:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784653.718552:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728030592 00000100:00100000:2.0:1787784653.718562:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728030592 00000100:00100000:2.0:1787784653.718635:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:2.0:1787784653.718646:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2660f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+24:11300:x1874627728030592:12345-192.168.202.41@tcp:58:lfs.0 00010000:00010000:2.0:1787784653.718798:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d321 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.718816:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d321 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784653.718829:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d321 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784653.719364:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784653.719493:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787784653.719601:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787784653.721237:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2660f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+24:11300:x1874627728030592:12345-192.168.202.41@tcp:58:lfs.0 Request processed in 2584us (2775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784653.721250:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:1.0:1787784653.754577:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784653.758415:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728030720 00000100:00100000:0.0:1787784653.758497:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728030720 00000100:00100000:0.0:1787784653.758639:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 77 00000100:00100000:0.0:1787784653.758651:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+24:11302:x1874627728030720:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784653.758673:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784653.758695:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d328 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a7e expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.758791:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d32f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.758807:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d32f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.758822:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d32f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.758837:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d336 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.758844:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.758851:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.758931:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d33d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.760778:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d33d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.760791:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d33d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784653.760845:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787784653.760850:0:7991:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784653.760882:0:7991:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d33d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.760894:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d33d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.760904:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d32f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.760910:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d32f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.760918:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d32f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.760924:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784653.760928:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d32f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.760936:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d32f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.760949:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:0.0:1787784653.761114:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784653.761133:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d32f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.761141:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d32f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.761160:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.761167:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d336 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.761173:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d336 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.761178:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784653.761181:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d336 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.761187:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d336 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.761195:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8950c23c8f00) 00010000:00010000:0.0:1787784653.761198:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784653.761201:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d336 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.761208:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d336 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.761246:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d328 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a7e expref: 26 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.761272:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d33d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a7e expref: 25 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784653.761280:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:0.0:1787784653.761282:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784653.761285:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628800, rc 0) 00000100:00100000:0.0:1787784653.761368:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+25:11302:x1874627728030720:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 2719us (6801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784653.761378:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 77 00010000:00010000:1.0:1787784654.346381:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787784654.725936:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784654.725954:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784654.725993:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787784654.726001:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784654.726134:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26603c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1874627750138624:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787784654.726231:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c36856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784654.733681:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26603c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1874627750138624:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787784654.738570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784654.738751:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728030848 00000100:00100000:0.0:1787784654.738761:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728030848 00000100:00100000:0.0:1787784654.738853:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:0.0:1787784654.738863:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+25:11313:x1874627728030848:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787784654.738894:0:6523:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787784654.739009:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+25:11313:x1874627728030848:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 147us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784654.739016:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00080000:3.0:1787784654.740226:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784654.747935:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784654.750852:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728030976 00000100:00100000:1.0:1787784654.750866:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728030976 00000100:00100000:1.0:1787784654.750984:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00100000:1.0:1787784654.750996:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+25:11313:x1874627728030976:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787784654.751066:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d344 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751084:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d344 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751096:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d344 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751118:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d34b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751126:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d34b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751134:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d34b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751159:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d352 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751169:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751176:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784654.751231:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787784654.751235:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787784654.751251:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751271:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d344 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751279:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d344 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751286:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d344 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751302:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784654.751307:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d344 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751315:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d344 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751327:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951f5128c00) 00010000:00010000:1.0:1787784654.751330:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784654.751334:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d344 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751340:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d344 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751351:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d34b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751356:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d34b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751362:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d34b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751367:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784654.751369:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d34b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751375:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d34b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751392:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8950c26a3000) 00010000:00010000:1.0:1787784654.751395:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784654.751398:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d34b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751403:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d34b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751429:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751435:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d352 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751441:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d352 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751446:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784654.751449:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d352 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751455:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d352 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751462:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:1.0:1787784654.751464:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784654.751467:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d352 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.751472:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d352 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784654.751573:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+25:11313:x1874627728030976:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 Request processed in 578us (3648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784654.751581:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00100000:3.0:1787784654.756841:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784654.758674:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728031232 00000100:00100000:2.0:1787784654.758689:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728031232 00000100:00100000:2.0:1787784654.758762:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 80 00000100:00100000:2.0:1787784654.758792:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+25:11313:x1874627728031232:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784654.758813:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784654.758851:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d359 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a85 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.758970:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d360 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.758985:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.758998:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784654.759008:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787784654.759086:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.759095:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d360 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.759102:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d360 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.759108:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ac00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784654.759113:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d360 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.759121:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d360 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.759133:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:2.0:1787784654.759136:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784654.759141:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d360 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.759157:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d360 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.759205:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d359 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a85 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.759216:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951f5128c00) 00010000:00010000:2.0:1787784654.759219:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784654.759223:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d359 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a85 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.759233:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5bc00, rc 0) 00000100:00100000:2.0:1787784654.759296:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+26:11313:x1874627728031232:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 507us (2464us total) trans 4294967354 rc 301/301 00000100:00100000:2.0:1787784654.759304:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 80 00000100:00100000:3.0:1787784654.762514:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784654.762559:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728031360 00000100:00100000:3.0:1787784654.762569:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728031360 00000100:00100000:3.0:1787784654.762624:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 81 00000100:00100000:3.0:1787784654.762635:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+26:11313:x1874627728031360:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787784654.762682:0:11332:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787784654.762814:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+26:11313:x1874627728031360:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 181us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784654.762822:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 81 00000100:00100000:3.0:1787784654.783525:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784654.783654:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728031616 00000100:00100000:1.0:1787784654.783664:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728031616 00000100:00100000:1.0:1787784654.783724:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 82 00000100:00100000:1.0:1787784654.783734:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+26:11313:x1874627728031616:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784654.783756:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784654.783759:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787784654.783808:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d31a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a77 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.783831:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:1.0:1787784654.783836:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784654.783849:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d36e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a8c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787784654.784252:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787784654.784414:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d375 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.784428:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d375 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.784438:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d375 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.784485:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d36e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a8c expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.784515:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d375 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a8c expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.784524:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8950c26a3300) 00010000:00010000:1.0:1787784654.784528:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784654.784530:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602800, rc 0) 00000100:00100000:1.0:1787784654.784603:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+27:11313:x1874627728031616:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 870us (1088us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787784654.784613:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 82 00000100:00100000:2.0:1787784654.788353:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784654.788763:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728031872 00000100:00100000:1.0:1787784654.788797:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728031872 00000100:00100000:1.0:1787784654.788852:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:1.0:1787784654.788862:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3387840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+27:11313:x1874627728031872:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787784654.788922:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784654.788952:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d375 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a8c expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.788971:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8950c26a3300) 00010000:00010000:1.0:1787784654.788981:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784654.789002:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d383 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789015:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d383 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789026:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d383 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789052:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d38a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xad60d742 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789059:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d38a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xad60d742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789066:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d38a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xad60d742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789115:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d383 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789121:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d383 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789127:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d383 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789133:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784654.789136:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d383 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789143:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d383 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789151:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:1.0:1787784654.789154:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784654.789157:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d383 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789162:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d383 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789179:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d38a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xad60d742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789186:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d38a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xad60d742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789378:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d38a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xad60d742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789384:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784654.789387:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d38a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xad60d742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789393:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d38a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xad60d742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789402:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xad60d742 (ffff8950c26a3000) 00010000:00010000:1.0:1787784654.789404:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784654.789417:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d38a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xad60d742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.789424:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d38a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xad60d742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784654.789518:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3387840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+26:11313:x1874627728031872:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 657us (1173us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787784654.789527:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:2.0:1787784654.799504:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784654.799693:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728032000 00000100:00100000:3.0:1787784654.799702:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728032000 00000100:00100000:3.0:1787784654.799763:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:3.0:1787784654.799798:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c33852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+26:11313:x1874627728032000:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784654.799817:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784654.799839:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d391 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a93 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784654.799875:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d398 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784654.799888:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784654.799898:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784654.800007:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9d391 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a93 expref: 28 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784654.800022:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a93 expref: 27 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784654.800041:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8951c3a5b200) 00010000:00010000:3.0:1787784654.800044:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787784654.800048:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713600, rc 0) 00000100:00100000:3.0:1787784654.800104:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c33852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+27:11313:x1874627728032000:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 310us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784654.800112:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 84 00000040:00080000:2.0:1787784654.824050:0:14221:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787784654.824061:0:14221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784654.824116:0:14221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787784654.824123:0:14221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784654.825734:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784654.825765:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728032256 00000100:00100000:3.0:1787784654.825797:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728032256 00000100:00100000:3.0:1787784654.825852:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 85 00000100:00100000:3.0:1787784654.825864:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2609680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+27:11313:x1874627728032256:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787784654.825946:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9d39f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784654.825962:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9d39f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784654.825973:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9d39f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784654.826151:0:11332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787784654.826161:0:11332:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395075391853ns, next at 396075389458ns, rc = 0 00000004:00010000:3.0:1787784654.826221:0:11332:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fac6b5e1 reply state 00000000c7c1fac6 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9d39f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784654.826233:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9d39f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784654.826271:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8951c3a5b200) 00010000:00010000:3.0:1787784654.826274:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787784654.826278:0:11332:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787784654.826381:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2609680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+29:11313:x1874627728032256:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 519us (655us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1787784654.826388:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 85 00000100:00100000:2.0:1787784654.831104:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784654.833701:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728032384 00000100:00100000:1.0:1787784654.833715:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728032384 00000100:00100000:1.0:1787784654.833804:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 86 00000100:00100000:1.0:1787784654.833823:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+29:11313:x1874627728032384:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784654.833848:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784654.833879:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d3a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72a9a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.833940:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d3a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a9a expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.833955:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d3a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a9a expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784654.833974:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8951c3a5b200) 00010000:00010000:1.0:1787784654.833977:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784654.833981:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602c00, rc 0) 00000100:00100000:1.0:1787784654.834051:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+30:11313:x1874627728032384:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 230us (2957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784654.834058:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 86 00000100:00100000:0.0:1787784654.837751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784654.837868:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728032512 00000100:00100000:1.0:1787784654.837879:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728032512 00000100:00100000:1.0:1787784654.837928:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:1.0:1787784654.837939:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2404:x1874627728032512:12345-192.168.202.41@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787784654.837977:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:1.0:1787784654.838011:0:8436:0:(genops.c:1385:class_connect()) connect: client 2e90d38f-8956-47bc-80da-c902c22ae09c, cookie 0x88ace7295d9d3ad 00002000:00100000:1.0:1787784654.838024:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e90d38f-8956-47bc-80da-c902c22ae09c/ffff8950c4024800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787784654.838048:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787784654.838132:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787784654.838171:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8950c4022800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784654.838246:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2404:x1874627728032512:12345-192.168.202.41@tcp:8:lhsmtool_posix.0 Request processed in 307us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784654.838254:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:1.0:1787784654.844676:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784654.844749:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728032640 00000100:00100000:2.0:1787784654.844759:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728032640 00000100:00100000:2.0:1787784654.844846:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:2.0:1787784654.844859:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:0:x1874627728032640:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787784654.845269:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787784654.848839:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1787784654.848857:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00000100:00100000:1.0:1787784654.855167:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:0:x1874627728032640:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 10299us (10489us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787784654.855181:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:2.0:1787784654.865954:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784654.865993:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728032896 00000100:00100000:2.0:1787784654.866001:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728032896 00000100:00100000:2.0:1787784654.866060:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:1.0:1787784654.866066:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1787784654.866070:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+30:11313:x1874627728032896:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787784654.866076:0:6524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1787784654.866295:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+31:11313:x1874627728032896:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 225us (348us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1787784654.866303:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:1.0:1787784654.871431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784654.871465:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728033152 00000100:00100000:1.0:1787784654.871473:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728033152 00000100:00100000:1.0:1787784654.871563:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00100000:1.0:1787784654.871575:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+31:11313:x1874627728033152:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787784654.871673:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+31:11313:x1874627728033152:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 101us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784654.871682:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00100000:3.0:1787784654.893219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784654.893497:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728033280 00000100:00100000:0.0:1787784654.893507:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728033280 00000100:00100000:0.0:1787784654.893746:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 88 00000100:00100000:0.0:1787784654.893757:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+31:11313:x1874627728033280:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784654.893802:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784654.893837:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72aa1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784654.893907:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d3bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784654.893923:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d3bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784654.893936:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d3bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784654.893981:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784654.894001:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d3bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784654.894027:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aa1 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784654.894046:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d3bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aa1 expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784654.894057:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8951c3a5b200) 00010000:00010000:0.0:1787784654.894060:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787784654.894063:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629400, rc 0) 00000100:00100000:0.0:1787784654.894126:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+32:11313:x1874627728033280:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 371us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784654.894133:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 88 00000100:00100000:2.0:1787784654.917964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784654.918039:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728033408 00000100:00100000:3.0:1787784654.918048:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728033408 00000100:00100000:3.0:1787784654.918110:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:3.0:1787784654.918122:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728033408:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784654.918140:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784654.918160:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e3cbc2e/0x88ace7295d9d3c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72aa8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784654.918188:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6dce, blocks: 0x0 00010000:00010000:3.0:1787784654.918216:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1787784654.918220:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784654.918230:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e3cbc2e/0x88ace7295d9d3c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aa8 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784654.918248:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e3cbc2e/0x88ace7295d9d3c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aa8 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784654.918260:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712c00, rc 0) 00000100:00100000:3.0:1787784654.918327:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728033408:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 207us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784654.918335:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:3.0:1787784654.932446:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784654.932521:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728033664 00000100:00100000:2.0:1787784654.932530:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728033664 00000100:00100000:2.0:1787784654.932592:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 89 00000100:00100000:2.0:1787784654.932601:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+32:11313:x1874627728033664:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787784654.932697:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+32:11313:x1874627728033664:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 97us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784654.932703:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 89 00000100:00100000:2.0:1787784654.941112:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784654.941161:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728033792 00000100:00100000:2.0:1787784654.941170:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728033792 00000100:00100000:2.0:1787784654.941225:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:2.0:1787784654.941237:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:11313:x1874627728033792:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784654.941254:0:8916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784654.941274:0:8916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d3c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72aaf expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.941320:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e3cbc2e/0x88ace7295d9d3c2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aa8 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.941329:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784654.941333:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784654.941339:0:8916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d3c9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aaf expref: 7 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.941379:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e3cbc2e/0x88ace7295d9d3c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aa8 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.941393:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e3cbc2e/0x88ace7295d9d3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aa8 expref: 7 pid: 8436 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784654.941408:0:8916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750138752:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784654.941494:0:8916:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa994cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784654.946223:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784654.946260:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728033920 00000100:00100000:2.0:1787784654.946268:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728033920 00010000:00010000:2.0:1787784654.946307:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e3cbc2e/0x88ace7295d9d3c2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aa8 expref: 8 pid: 8436 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784654.946343:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:2.0:1787784654.946353:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2406:x1874627728033920:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784654.946378:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784654.946401:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005e3cbc2e/0x88ace7295d9d3c2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aa8 expref: 8 pid: 8436 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.946414:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005e3cbc2e/0x88ace7295d9d3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aa8 expref: 8 pid: 8436 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.946444:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784654.946449:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784654.946458:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d3c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aaf expref: 8 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.946469:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d3c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aaf expref: 8 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.946504:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d3c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aaf expref: 8 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784654.946519:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1874627750138880:192.168.202.41@tcp:105: 00000100:00100000:2.0:1787784654.946606:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c78f5000 going to sleep for 11 seconds 00010000:00010000:2.0:1787784654.946697:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e3cbc2e/0x88ace7295d9d3c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aa8 expref: 8 pid: 8436 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784654.946711:0:8916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750138752:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784654.946733:0:8916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d3c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aaf expref: 7 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.946750:0:8916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5be00, rc 0) 00000100:00100000:2.0:1787784654.946809:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:11313:x1874627728033792:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 5575us (5719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784654.946816:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:0.0:1787784654.964072:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1874627750138880:192.168.202.41@tcp:105: 00010000:00010000:0.0:1787784654.964100:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784654.964174:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627728033920:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 17820us (17961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784654.964195:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:2.0:1787784654.966136:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784654.966312:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728034048 00000100:00100000:0.0:1787784654.966321:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728034048 00002000:00100000:0.0:1787784654.966370:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8950c3412d00 x1874627728034048/t0(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:535/0 lens 504/0 e 0 to 0 dl 1787784665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784654.966382:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c3412d00 with x1874627728034048 ext(0->8) 00002000:00010000:0.0:1787784654.966388:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c3412d00 00000100:00100000:0.0:1787784654.966435:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:0.0:1787784654.966445:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728034048:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787784654.967413:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2405:x1874627728034048:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 Request processed in 953us (1270us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787784654.967424:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00002000:00100000:0.0:1787784654.967433:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8950c3412d00 x1874627728034048/t4294967303(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:535/0 lens 504/448 e 0 to 0 dl 1787784665 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784654.967443:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c3412d00 with x1874627728034048 ext(0->8) 00002000:00010000:0.0:1787784654.967447:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c3412d00 00000100:00100000:1.0:1787784654.987742:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784654.987887:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784654.987907:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2608b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750139008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787784654.987961:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784654.988014:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750139008 00000100:00100000:3.0:1787784654.988022:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750139008 00000100:00100000:3.0:1787784654.988077:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787784654.988087:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750139008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784654.988126:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787784654.988174:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750139008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784654.988181:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787784654.988310:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2608b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750139008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784654.988419:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728034176 00000100:00100000:2.0:1787784654.988424:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728034176 00000100:00100000:2.0:1787784654.988465:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 90 00000100:00100000:2.0:1787784654.988472:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+32:11313:x1874627728034176:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787784654.994877:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:3.0:1787784654.994891:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787784654.994932:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1787784654.995041:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:2.0:1787784654.995044:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d29c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787784654.995051:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:2.0:1787784654.995056:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d29c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.995063:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d29c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.995069:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784654.995073:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d29c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.995080:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d29c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.995096:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:2.0:1787784654.995099:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784654.995116:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d29c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.995122:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d29c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.995138:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9d39f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.995143:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9d39f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.995148:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9d39f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.995153:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784654.995156:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9d39f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.995161:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9d39f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784654.995168:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8951c3a5b200) 00000100:00100000:3.0:1787784654.995169:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+15:11313:x1874627728034176:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 Request processed in 6692us (7431us total) trans 0 rc 0/0 00010000:00010000:2.0:1787784654.995171:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787784654.995174:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9d39f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784654.995179:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 90 00010000:00010000:2.0:1787784654.995179:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9d39f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784654.995369:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784654.995385:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2608b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750139136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787784654.995435:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784654.997514:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750139136 00000100:00100000:2.0:1787784654.997527:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750139136 00000100:00100000:2.0:1787784654.997606:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787784654.997623:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2609a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750139136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787784654.997752:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787784654.997755:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787784654 00002000:00010000:2.0:1787784654.997758:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787784654.997760:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787784654 -> 1787784654 00002000:00010000:2.0:1787784654.997762:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787784654.997844:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2609a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750139136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (2407us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787784654.997851:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1787784654.997907:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8950c2608b40/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787784654.997913:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2608b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750139136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787784654.999460:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784654.999490:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728034304 00000100:00100000:3.0:1787784654.999497:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728034304 00000100:00100000:3.0:1787784654.999551:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:3.0:1787784654.999562:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2408:x1874627728034304:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1787784655.000504:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787784655.006937:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1787784655.007053:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1787784655.007798:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627728034304:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 Request processed in 8231us (8336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784655.007810:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:3.0:1787784655.019220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784655.019308:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728034560 00000100:00100000:1.0:1787784655.019318:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728034560 00000100:00100000:1.0:1787784655.019377:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 91 00000100:00100000:1.0:1787784655.019386:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2608f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+14:11313:x1874627728034560:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787784655.019452:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784655.019479:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d3bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aa1 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784655.019512:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8951c3a5b200) 00010000:00010000:1.0:1787784655.019517:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784655.019561:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d3d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784655.019575:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d3d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784655.019585:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d3d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784655.019705:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000445dfd38 reply state 00000000604fd304 transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d3d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784655.019718:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d3d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784655.019725:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8951c3a5b200) 00010000:00010000:1.0:1787784655.019728:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787784655.019731:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784655.022721:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2608f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+15:11313:x1874627728034560:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 3325us (3502us total) trans 4294967358 rc 0/0 00000100:00100000:1.0:1787784655.022734:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 91 00000100:00100000:2.0:1787784655.030251:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784655.030372:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728034688 00000100:00100000:0.0:1787784655.030381:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728034688 00000100:00100000:0.0:1787784655.030439:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:0.0:1787784655.030449:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728034688:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787784655.030623:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787784655.030627:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787784654 -> 1787784653 00002000:00010000:0.0:1787784655.030642:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787784650 00002000:00010000:0.0:1787784655.030644:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787784654 -> 1787784653 00002000:00010000:0.0:1787784655.030646:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787784655.030714:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728034688:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 265us (469us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787784655.030721:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:3.0:1787784655.034058:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784655.034131:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728034944 00000100:00100000:2.0:1787784655.034140:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728034944 00000100:00100000:2.0:1787784655.034208:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:2.0:1787784655.034219:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+15:11313:x1874627728034944:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787784655.034286:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.034302:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d398 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a93 expref: 15 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.034313:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.034353:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a93 expref: 15 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.034367:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d398 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a93 expref: 15 pid: 7991 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784655.034383:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750139264:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784655.034475:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c78f5180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784655.056432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784655.057065:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728035072 00000100:00100000:0.0:1787784655.057076:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728035072 00010000:00010000:0.0:1787784655.057119:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d398 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a93 expref: 16 pid: 7991 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784655.057155:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:0.0:1787784655.057166:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d73840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+16:2406:x1874627728035072:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784655.057184:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784655.057202:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d398 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a93 expref: 16 pid: 7991 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.057216:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d398 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a93 expref: 16 pid: 7991 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.057238:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8951c3a5b200) 00010000:00010000:0.0:1787784655.057244:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.057254:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.057262:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.057288:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784655.057343:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d73840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+16:2406:x1874627728035072:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 178us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784655.057351:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 66 00010000:00010000:2.0:1787784655.063342:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d398 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a93 expref: 15 pid: 7991 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784655.063367:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750139264:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784655.063390:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.063401:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.063486:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.063526:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.063545:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.063552:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.063571:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5bc00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784655.063575:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.063583:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.063599:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8951c3a5b200) 00010000:00010000:2.0:1787784655.063602:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787784655.063607:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.063613:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3d7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784655.063760:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+14:11313:x1874627728034944:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 Request processed in 29542us (29710us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787784655.063785:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:1.0:1787784655.082618:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784655.083754:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728035200 00000100:00100000:0.0:1787784655.083785:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728035200 00000100:00100000:0.0:1787784655.083840:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:0.0:1787784655.083852:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3577c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728035200:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787784655.083904:0:8916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.083926:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d3c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aaf expref: 7 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.083935:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784655.083952:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787784655.083957:0:8916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.083994:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d3c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aaf expref: 7 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.084010:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d3c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aaf expref: 7 pid: 8916 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784655.084024:0:8916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750139392:192.168.202.41@tcp:104: 00000100:00100000:0.0:1787784655.084114:0:8916:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d2535840 going to sleep for 11 seconds 00000100:00100000:0.0:1787784655.102695:0:8916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750139392:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784655.102726:0:8916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784655.104309:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784655.104351:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728035328 00000100:00100000:0.0:1787784655.104359:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728035328 00010000:00010000:0.0:1787784655.104395:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d3c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aaf expref: 8 pid: 8916 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784655.105151:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:0.0:1787784655.105162:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2406:x1874627728035328:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784655.105180:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784655.106012:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d3c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aaf expref: 8 pid: 8916 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.106031:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d3c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aaf expref: 8 pid: 8916 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.106056:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d3c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aaf expref: 8 pid: 8916 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.106069:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787784655.106073:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787784655.106079:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.106100:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.106138:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784655.106210:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2406:x1874627728035328:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 1050us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784655.106219:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00010000:00010000:3.0:1787784655.109831:0:8916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784655.109853:0:8916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784655.109886:0:8916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784655.109895:0:8916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784655.109904:0:8916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784655.109912:0:8916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784655.109916:0:8916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784655.109944:0:8916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784655.109964:0:8916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784655.109971:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080ea5ee5/0x88ace7295d9d3de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784655.110114:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3577c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728035200:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 Request processed in 26259us (27498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784655.110125:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:3.0:1787784655.131819:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784655.131916:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728035584 00000100:00100000:1.0:1787784655.131926:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728035584 00000100:00100000:1.0:1787784655.131997:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 93 00000100:00100000:1.0:1787784655.132006:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5628b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+14:11313:x1874627728035584:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787784655.132098:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784655.132115:0:11332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d225 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a38 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784655.132124:0:11332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784655.132158:0:11332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d225 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a38 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784655.132171:0:11332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d225 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a38 expref: 14 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784655.132184:0:11332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35743c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750139520:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784655.132284:0:11332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f527a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784655.144835:0:11332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35743c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750139520:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784655.144870:0:11332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784655.154493:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784655.154906:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728035712 00000100:00100000:0.0:1787784655.154916:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728035712 00010000:00010000:0.0:1787784655.154972:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d225 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a38 expref: 15 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784655.155004:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:0.0:1787784655.155014:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+15:2406:x1874627728035712:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784655.155029:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784655.155036:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d225 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a38 expref: 15 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.155049:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d225 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a38 expref: 15 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.155072:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d225 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a38 expref: 15 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.155088:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:0.0:1787784655.155105:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.155116:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.155124:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.155152:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784655.155218:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+14:2406:x1874627728035712:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 205us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784655.155226:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00010000:00010000:0.0:1787784655.155271:0:11332:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.155279:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.155438:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.155450:0:11332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d3a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a9a expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.155459:0:11332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.155487:0:11332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d3a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a9a expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.155501:0:11332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d3a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a9a expref: 14 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784655.155521:0:11332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750139648:192.168.202.41@tcp:104: 00000100:00100000:0.0:1787784655.155579:0:11332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c83c9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784655.165099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784655.166598:0:11332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750139648:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784655.166627:0:11332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784655.166930:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728035840 00000100:00100000:0.0:1787784655.167548:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728035840 00010000:00010000:0.0:1787784655.167595:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d3a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a9a expref: 15 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784655.167638:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:0.0:1787784655.167649:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+15:2405:x1874627728035840:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784655.167664:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784655.167672:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d3a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a9a expref: 15 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.167684:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d3a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a9a expref: 15 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.167706:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d3a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a9a expref: 15 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.167721:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8951c3a5b200) 00010000:00010000:0.0:1787784655.167726:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.167735:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.167756:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.167807:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784655.167862:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+14:2405:x1874627728035840:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 214us (3025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784655.167870:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 69 00010000:00010000:0.0:1787784655.169839:0:11332:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.169855:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784655.169966:0:11332:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1787784655.170074:0:11332:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:0.0:1787784655.170106:0:11332:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1787784655.170199:0:11332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11332:1874627750139776:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787784655.170255:0:11332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784655.170291:0:11332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0a310c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784655.171570:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750139776 00000100:00100000:3.0:1787784655.171581:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750139776 00000100:00100000:3.0:1787784655.171676:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787784655.171688:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11332:x1874627750139776:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787784655.171825:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11332:x1874627750139776:12345-0@lo:1000:mdt00_004.0 Request processed in 140us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784655.171833:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787784655.171903:0:11332:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787784655.171909:0:11332:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8950c2608b40, transno 4294967304 00000100:00100000:2.0:1787784655.171933:0:11332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11332:1874627750139776:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1787784655.172077:0:11332:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:2.0:1787784655.172134:0:11332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c19f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11332:1874627750139904:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787784655.172182:0:11332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784655.172584:0:11332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784655.172611:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750139904 00000100:00100000:3.0:1787784655.172622:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750139904 00000100:00100000:3.0:1787784655.172647:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787784655.172654:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11332:x1874627750139904:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787784655.172891:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11332:x1874627750139904:12345-0@lo:1000:mdt00_004.0 Request processed in 237us (708us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787784655.172899:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787784655.173046:0:11332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c19f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11332:1874627750139904:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1787784655.173085:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173095:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173102:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173108:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784655.173112:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173120:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173134:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8951c3a5b200) 00010000:00010000:2.0:1787784655.173137:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784655.173141:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173147:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d3ec lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173176:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d321 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173183:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d321 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173262:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d321 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173268:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5a800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784655.173271:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d321 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173278:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d321 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173287:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:2.0:1787784655.173290:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784655.173293:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d321 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173300:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d321 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173322:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173337:0:11332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d33d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a7e expref: 17 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173347:0:11332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173385:0:11332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d33d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a7e expref: 17 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.173399:0:11332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d33d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a7e expref: 17 pid: 7991 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784655.173483:0:11332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750140032:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784655.173601:0:11332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa994c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784655.181161:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784655.181367:0:11332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750140032:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784655.181394:0:11332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784655.181494:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728035968 00000100:00100000:0.0:1787784655.181501:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728035968 00010000:00010000:0.0:1787784655.181544:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d33d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a7e expref: 18 pid: 7991 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784655.181609:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:0.0:1787784655.181619:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+18:2405:x1874627728035968:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784655.181633:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784655.181640:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d33d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a7e expref: 18 pid: 7991 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.181665:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d33d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a7e expref: 18 pid: 7991 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.181688:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d33d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72a7e expref: 18 pid: 7991 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.181702:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:0.0:1787784655.181707:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.181716:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.181724:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784655.181751:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784655.181830:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+17:2405:x1874627728035968:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 213us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784655.181838:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 70 00010000:00010000:2.0:1787784655.181888:0:11332:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.181895:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.181907:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.181914:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.181921:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.181926:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5bc00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784655.181930:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.181937:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.181955:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:2.0:1787784655.181964:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784655.181968:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.181974:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d3f3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.181984:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.181990:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.181995:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.181999:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784655.182002:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.182008:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.182016:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951f5128f00) 00010000:00010000:2.0:1787784655.182018:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787784655.182021:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.182026:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d3e5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784655.182141:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5628b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+16:11313:x1874627728035584:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 50136us (50331us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1787784655.182157:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 93 00000020:00080000:2.0:1787784655.182161:0:11332:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787784655.185502:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784655.186701:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728036224 00000100:00100000:2.0:1787784655.186713:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728036224 00000100:00100000:2.0:1787784655.186797:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:2.0:1787784655.186808:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c56292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+16:11313:x1874627728036224:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787784655.187059:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787784655.187090:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:2.0:1787784655.187122:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d3fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.187139:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d3fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.187151:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d3fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.187161:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d3fa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.187168:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d3fa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.187175:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d3fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.187204:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787784655.187295:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c56292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+18:11313:x1874627728036224:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 488us (1803us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787784655.187302:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000020:00080000:2.0:1787784655.187320:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787784655.187340:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784655.187347:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d3fa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.187355:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ba00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784655.187358:0:10397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d3fa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.187367:0:10397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d3fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.187379:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8951c3a5b200) 00010000:00010000:2.0:1787784655.187383:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787784655.187387:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d3fa lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.187393:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d3fa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784655.187415:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784655.187417:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784655.187419:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787784655.188377:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787784655.188383:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784655.188401:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787784655.188621:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787784655.366163:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784656.389991:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787784656.526578:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1787784656.526594:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000040:00080000:0.0:1787784656.851287:0:14273:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787784656.851297:0:14273:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784656.851321:0:14273:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787784656.851328:0:14273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784657.116136:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784657.121695:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728036480 00000100:00100000:1.0:1787784657.121708:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728036480 00000100:00080000:2.0:1787784657.121819:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784657.121856:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 94 00000100:00100000:1.0:1787784657.121868:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+18:11331:x1874627728036480:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787784657.121891:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784657.121913:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ab6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.122036:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9d408 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.122049:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9d408 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.122062:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9d408 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784657.122073:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787784657.122173:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ab6 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.122187:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9d408 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ab6 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.122195:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:1.0:1787784657.122198:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787784657.122201:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603a00, rc 0) 00000100:00100000:1.0:1787784657.122277:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+20:11331:x1874627728036480:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 411us (6152us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787784657.122285:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 94 00000100:00100000:1.0:1787784657.133833:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.133951:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728036608 00000100:00100000:2.0:1787784657.133961:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728036608 00000100:00100000:2.0:1787784657.134021:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00100000:2.0:1787784657.134032:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+20:11331:x1874627728036608:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:2.0:1787784657.134107:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d416 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134135:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d416 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134163:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d416 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134183:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d41d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134190:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d41d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134198:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d41d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134282:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d424 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134292:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134299:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784657.134344:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134358:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d416 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134364:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d416 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134381:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d416 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134397:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5a000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784657.134402:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d416 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134409:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d416 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134420:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784657.134423:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784657.134427:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d416 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134435:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d416 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134446:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d41d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134452:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d41d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134457:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d41d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134462:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5a800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784657.134465:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d41d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134481:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d41d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134489:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8951e0a67a00) 00010000:00010000:2.0:1787784657.134492:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784657.134495:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d41d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134500:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d41d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134522:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134529:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d424 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134535:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d424 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134540:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5bc00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784657.134543:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d424 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134550:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d424 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134557:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67d00) 00010000:00010000:2.0:1787784657.134560:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784657.134562:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d424 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.134576:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d424 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784657.134660:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+20:11331:x1874627728036608:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 629us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.134669:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00100000:2.0:1787784657.187307:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.187353:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.194008:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728036992 00000100:00100000:2.0:1787784657.194031:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728036992 00000100:00100000:2.0:1787784657.194154:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 86 00000100:00100000:2.0:1787784657.194179:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7809a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728036992:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784657.194263:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7809a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728036992:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 100us (6909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.194270:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 86 00000100:00100000:1.0:1787784657.194804:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728036736 00000100:00100000:1.0:1787784657.194810:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728036736 00000100:00100000:1.0:1787784657.194864:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 416 00000100:00100000:1.0:1787784657.194874:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2405:x1874627728036736:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784657.194935:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2405:x1874627728036736:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 63us (7638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784657.194942:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 416 00000100:00080000:0.0:1787784657.196708:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784657.207729:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.207783:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.207810:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.207848:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.207887:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728037248 00000100:00100000:2.0:1787784657.207896:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728037248 00000100:00100000:1.0:1787784657.207941:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728036864 00000100:00100000:1.0:1787784657.207947:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728036864 00000100:00100000:2.0:1787784657.207961:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728037376 00000100:00100000:2.0:1787784657.207966:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728037376 00000100:00100000:1.0:1787784657.207989:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 311 00000100:00100000:1.0:1787784657.208001:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728037248:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784657.208077:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728037248:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 78us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.208595:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 312 00000100:00100000:2.0:1787784657.208607:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c780b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728036864:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784657.208642:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c780b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728036864:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 39us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.208661:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 312 00000100:00100000:2.0:1787784657.208678:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 313 00000100:00100000:2.0:1787784657.208685:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c780a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728037376:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784657.208709:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c780a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728037376:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.208715:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 313 00000100:00100000:2.0:1787784657.208739:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728037120 00000100:00100000:2.0:1787784657.208743:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728037120 00000100:00100000:2.0:1787784657.208894:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00100000:2.0:1787784657.208903:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c78083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728037120:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784657.208929:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c78083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728037120:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.208936:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00080000:2.0:1787784657.208955:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784657.208959:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784657.208962:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784657.217240:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.217480:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728037632 00000100:00100000:2.0:1787784657.217489:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728037632 00000100:00100000:2.0:1787784657.217561:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 96 00000100:00100000:2.0:1787784657.217572:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+20:11334:x1874627728037632:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784657.217592:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784657.217613:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d42b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72abd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.217685:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d432 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.217712:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.217724:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.217739:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d439 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.217746:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.217753:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.217954:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d440 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.217962:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.217969:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784657.217978:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787784657.218051:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218059:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d432 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218066:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d432 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218078:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ba00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784657.218082:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d432 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218089:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d432 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218101:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784657.218104:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784657.218108:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d432 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218114:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d432 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218128:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218133:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d439 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218139:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218144:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784657.218147:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218153:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d439 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218385:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8951e0a67d00) 00010000:00010000:2.0:1787784657.218388:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784657.218392:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d439 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218399:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d439 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218439:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d42b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72abd expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218453:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72abd expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.218461:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784657.218463:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784657.218465:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5b400, rc 0) 00000100:00100000:2.0:1787784657.218540:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11334:x1874627728037632:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 970us (1311us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1787784657.218549:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 96 00000100:00100000:1.0:1787784657.218763:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 311 00000100:00100000:2.0:1787784657.223702:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784657.223803:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728037760 00000100:00100000:0.0:1787784657.223812:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728037760 00000100:00100000:0.0:1787784657.223871:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 97 00000100:00100000:0.0:1787784657.223881:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c780b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11334:x1874627728037760:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:0.0:1787784657.223945:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d44e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.223962:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d44e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.223973:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d44e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.224006:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d44e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.224013:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d44e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.224020:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d44e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.224025:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784657.224029:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d44e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.224037:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d44e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.224049:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784657.224060:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784657.224066:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d44e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.224072:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d44e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784657.224140:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c780b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11334:x1874627728037760:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 261us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784657.224147:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 97 00000100:00100000:0.0:1787784657.235942:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784657.236026:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728038016 00000100:00100000:1.0:1787784657.236036:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728038016 00000100:00100000:1.0:1787784657.236093:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:1.0:1787784657.236103:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f0040050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11334:x1874627728038016:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1787784657.236324:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f0040050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+23:11334:x1874627728038016:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 222us (392us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1787784657.236333:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:1.0:1787784657.318714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.319688:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728038272 00000100:00100000:2.0:1787784657.319702:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728038272 00000100:00100000:2.0:1787784657.319836:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 98 00000100:00100000:2.0:1787784657.319849:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+23:10852:x1874627728038272:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784657.319877:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784657.319901:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d455 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ac4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.320039:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.320056:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d440 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72abd expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.320065:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.320101:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72abd expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.320115:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72abd expref: 24 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784657.320128:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874627750140160:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784657.320442:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa994c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784657.329350:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874627750140160:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784657.329385:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784657.334931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784657.335602:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728038400 00000100:00100000:0.0:1787784657.335613:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728038400 00010000:00010000:0.0:1787784657.335696:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72abd expref: 25 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784657.335928:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:0.0:1787784657.335941:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff489680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+25:2405:x1874627728038400:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784657.335960:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784657.335968:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72abd expref: 25 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.335982:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72abd expref: 25 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.336005:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d440 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72abd expref: 25 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.336024:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784657.336041:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.336052:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.336061:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.336093:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784657.336158:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff489680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+24:2405:x1874627728038400:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 219us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784657.336166:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 71 00010000:00010000:2.0:1787784657.336225:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.336234:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784657.336254:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787784657.336394:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d455 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ac4 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.336411:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ac4 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.336418:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784657.336421:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787784657.336424:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5b800, rc 0) 00000100:00100000:2.0:1787784657.336462:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+24:10852:x1874627728038272:12345-192.168.202.41@tcp:101:bash.0 Request processed in 16617us (17759us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787784657.336470:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 98 00000100:00100000:2.0:1787784657.340133:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784657.340226:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728038528 00000100:00100000:1.0:1787784657.340237:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728038528 00000100:00100000:1.0:1787784657.340301:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00100000:1.0:1787784657.340312:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c780a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+24:10852:x1874627728038528:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1787784657.340336:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784657.340360:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d46a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72acb expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.340410:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d471 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.340426:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.340437:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.340556:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d46a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72acb expref: 26 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.340576:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d471 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72acb expref: 25 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.340585:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:1.0:1787784657.340588:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787784657.340592:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602e00, rc 0) 00000100:00100000:1.0:1787784657.340653:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c780a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+25:10852:x1874627728038528:12345-192.168.202.41@tcp:101:bash.0 Request processed in 343us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784657.340660:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00100000:1.0:1787784657.350147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.350239:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728038784 00000100:00100000:2.0:1787784657.350250:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728038784 00000100:00100000:2.0:1787784657.350315:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 100 00000100:00100000:2.0:1787784657.350326:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+25:10852:x1874627728038784:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:2.0:1787784657.354662:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d478 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.354687:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.354699:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784657.354808:0:7991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:2.0:1787784657.354857:0:7991:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000795fc2cb reply state 0000000064dce1a0 transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.354890:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d478 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.354898:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784657.354900:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784657.354905:0:7991:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787784657.354963:0:7991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:2.0:1787784657.355090:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+29:10852:x1874627728038784:12345-192.168.202.41@tcp:36:bash.0 Request processed in 4762us (4950us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787784657.355099:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 100 00000020:00080000:2.0:1787784657.355105:0:7991:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787784657.358678:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.358827:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728038912 00000100:00100000:2.0:1787784657.358837:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728038912 00000100:00100000:2.0:1787784657.358896:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 101 00000100:00100000:2.0:1787784657.358905:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+29:10852:x1874627728038912:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784657.358930:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784657.358949:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d47f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ad2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.359005:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d47f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ad2 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.359018:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d47f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ad2 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.359036:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784657.359040:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784657.359056:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5ba00, rc 0) 00000100:00100000:2.0:1787784657.359114:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+30:10852:x1874627728038912:12345-192.168.202.41@tcp:101:bash.0 Request processed in 210us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.359121:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 101 00000100:00100000:0.0:1787784657.367355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.367482:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728039040 00000100:00100000:2.0:1787784657.367491:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728039040 00000100:00100000:2.0:1787784657.367570:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:2.0:1787784657.367582:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:10852:x1874627728039040:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784657.367600:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784657.367620:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d486 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ad9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784657.367647:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f6dcd, atime: 0x6a8f6dca, ctime: 0x6a8f6dcd, blocks: 0x8 00010000:00010000:2.0:1787784657.367669:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1787784657.367675:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784657.367684:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d486 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ad9 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.367703:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d486 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ad9 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.367717:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5be00, rc 0) 00000100:00100000:2.0:1787784657.367836:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:10852:x1874627728039040:12345-192.168.202.41@tcp:101:bash.0 Request processed in 243us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.367843:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:3.0:1787784657.373983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784657.374160:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728039168 00000100:00100000:0.0:1787784657.374170:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728039168 00002000:00010000:0.0:1787784657.374212:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1787784657.374218:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8951c562a580 with x1874627728039168 ext(0->18446744073709551615) 00002000:00010000:0.0:1787784657.374231:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8951c562a580. 00000100:00100000:0.0:1787784657.374269:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:0.0:1787784657.374279:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728039168:12345-192.168.202.41@tcp:10:bash.0 00002000:00010000:0.0:1787784657.374687:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787784657.374692:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787784653 -> 1787784657 00002000:00010000:0.0:1787784657.374694:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1787784650 -> 1787784650 00002000:00010000:0.0:1787784657.374697:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787784653 -> 1787784657 00002000:00010000:0.0:1787784657.374699:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787784657.374817:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2405:x1874627728039168:12345-192.168.202.41@tcp:10:bash.0 Request processed in 492us (796us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787784657.374851:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00002000:00010000:0.0:1787784657.374855:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1787784657.374858:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8951c562a580 with x1874627728039168 ext(0->18446744073709551615) 00002000:00010000:0.0:1787784657.374864:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8951c562a580. 00010000:00010000:2.0:1787784657.414042:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784657.530300:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.530448:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728039296 00000100:00100000:2.0:1787784657.530469:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728039296 00000100:00100000:2.0:1787784657.530550:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 102 00000100:00100000:2.0:1787784657.530562:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c56292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+30:11348:x1874627728039296:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:2.0:1787784657.530644:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d48d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530660:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d48d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530670:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d48d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530684:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d494 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530692:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530697:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530760:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d49b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530793:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d49b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530799:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d49b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784657.530855:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d49b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530876:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d48d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530881:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d48d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530888:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d48d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530893:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784657.530897:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d48d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530903:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d48d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530914:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784657.530917:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784657.530921:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d48d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530926:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d48d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530939:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.530944:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d494 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.531019:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d494 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.531030:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ac00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784657.531033:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d494 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.531039:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d494 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.531047:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8951e0a67200) 00010000:00010000:2.0:1787784657.531049:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784657.531052:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d494 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.531057:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d494 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.531071:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d49b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.531078:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d49b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.531082:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d49b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.531087:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784657.531090:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d49b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.531095:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d49b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.531111:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784657.531113:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784657.531116:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d49b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.531121:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d49b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784657.531215:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c56292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+30:11348:x1874627728039296:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 655us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.531224:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 102 00000100:00100000:2.0:1787784657.609905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784657.610012:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728039552 00000100:00100000:0.0:1787784657.610022:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728039552 00000100:00100000:0.0:1787784657.610085:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 103 00000100:00100000:0.0:1787784657.610096:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+30:11351:x1874627728039552:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784657.610119:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784657.610142:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d4a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ae0 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610220:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610235:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610246:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610262:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610270:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610277:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610409:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d4b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610419:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d4b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610427:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d4b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784657.610437:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787784657.610528:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610535:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610543:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610549:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784657.610554:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610561:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610574:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:0.0:1787784657.610577:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784657.610581:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610587:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610611:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610617:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610622:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610627:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784657.610629:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610635:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610643:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8950c23c8000) 00010000:00010000:0.0:1787784657.610646:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784657.610649:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610666:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610707:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d4a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ae0 expref: 33 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610721:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d4b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ae0 expref: 32 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.610739:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784657.610741:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787784657.610744:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629400, rc 0) 00000100:00100000:0.0:1787784657.610995:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+32:11351:x1874627728039552:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 900us (1099us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787784657.611003:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 103 00000100:00100000:1.0:1787784657.613264:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784657.613326:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728039680 00000100:00100000:0.0:1787784657.613333:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728039680 00000100:00100000:0.0:1787784657.613432:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 104 00000100:00100000:0.0:1787784657.613443:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+32:11351:x1874627728039680:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:0.0:1787784657.613498:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.613520:0:11332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ac4 expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.613527:0:11332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.613555:0:11332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ac4 expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.613565:0:11332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ac4 expref: 32 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784657.613579:0:11332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750140288:192.168.202.41@tcp:104: 00000100:00100000:0.0:1787784657.613689:0:11332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c1254240 going to sleep for 11 seconds 00000100:00100000:0.0:1787784657.615827:0:11332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750140288:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787784657.615853:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00010000:00010000:0.0:1787784657.615854:0:11332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784657.616303:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728039936 00000100:00100000:2.0:1787784657.616309:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728039936 00000100:00100000:2.0:1787784657.616356:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:2.0:1787784657.616365:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+33:6178:x1874627728039936:12345-192.168.202.41@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787784657.616708:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+34:6178:x1874627728039936:12345-192.168.202.41@tcp:35:ldlm_bl.0 Request processed in 342us (853us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787784657.616716:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:3.0:1787784657.619294:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784657.619457:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728040064 00000100:00100000:1.0:1787784657.619465:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728040064 00010000:00010000:1.0:1787784657.619498:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ac4 expref: 34 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784657.619839:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:1.0:1787784657.619848:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+34:2406:x1874627728040064:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784657.619864:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784657.619872:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ac4 expref: 34 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.619885:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ac4 expref: 34 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.619909:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d45c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ac4 expref: 34 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.619925:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:1.0:1787784657.619930:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.619939:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.619946:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.619972:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784657.619986:0:11332:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.619993:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.620029:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.620047:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.620054:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.620060:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784657.620065:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784657.620065:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+33:2406:x1874627728040064:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 217us (777us total) trans 0 rc 0/0 00010000:00010000:2.0:1787784657.620074:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.620083:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784657.620086:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784657.620089:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.620094:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d4c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784657.620133:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+33:11351:x1874627728039680:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 6691us (6874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.620141:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 104 00000100:00100000:3.0:1787784657.623542:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784657.623816:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:2.0:1787784657.623990:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728040320 00000100:00100000:2.0:1787784657.624000:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728040320 00000100:00100000:2.0:1787784657.624056:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1787784657.624065:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+32:11351:x1874627728040320:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1787784657.624295:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+33:11351:x1874627728040320:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 230us (761us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787784657.624315:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:3.0:1787784657.713866:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.713970:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728040576 00000100:00100000:2.0:1787784657.713980:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728040576 00000100:00100000:2.0:1787784657.714044:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 105 00000100:00100000:2.0:1787784657.714054:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff479e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+33:11362:x1874627728040576:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:2.0:1787784657.714079:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784657.714099:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d4cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ae7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714183:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d4d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714198:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d4d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714210:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d4d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714224:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d4da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714231:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d4da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714238:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d4da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714352:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d4e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714379:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714386:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784657.714396:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787784657.714481:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d4d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714489:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d4d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714495:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d4d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714502:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ac00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784657.714518:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d4d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714527:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d4d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714540:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784657.714543:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784657.714548:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d4d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714555:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d4d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714570:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d4da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714583:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d4da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714588:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d4da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714593:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784657.714596:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d4da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714602:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d4da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714610:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8951e0a67200) 00010000:00010000:2.0:1787784657.714612:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784657.714615:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d4da lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714621:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d4da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714665:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d4cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ae7 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714678:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ae7 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.714686:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784657.714688:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784657.714695:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a800, rc 0) 00000100:00100000:2.0:1787784657.714761:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff479e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+35:11362:x1874627728040576:12345-192.168.202.41@tcp:101:cat.0 Request processed in 708us (905us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787784657.714816:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 105 00000100:00100000:3.0:1787784657.724212:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.724317:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728040832 00000100:00100000:2.0:1787784657.724326:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728040832 00000100:00100000:2.0:1787784657.724392:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:2.0:1787784657.724403:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+35:11362:x1874627728040832:12345-192.168.202.41@tcp:35:cat.0 00000100:00100000:2.0:1787784657.724699:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+36:11362:x1874627728040832:12345-192.168.202.41@tcp:35:cat.0 Request processed in 296us (495us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787784657.724707:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:3.0:1787784657.752469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784657.752623:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728041088 00000100:00100000:0.0:1787784657.752648:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728041088 00000100:00100000:0.0:1787784657.752736:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 106 00000100:00100000:0.0:1787784657.752751:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+36:11363:x1874627728041088:12345-192.168.202.41@tcp:36:rm.0 00010000:00010000:0.0:1787784657.752854:0:7991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787784657.752894:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d47f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ad2 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.752921:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d4e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ae7 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.752932:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d4b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ae0 expref: 34 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.752947:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d471 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72acb expref: 33 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.752959:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784657.752966:0:7991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784657.752996:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d4ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753016:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d4ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753048:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d4ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753067:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753074:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753080:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753185:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753194:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753200:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784657.753448:0:7991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1787784657.753458:0:7991:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398002689032ns, next at 399002686174ns, rc = 0 00010000:00010000:0.0:1787784657.753502:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d504 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753522:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753529:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753546:0:7991:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d504 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753552:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d504 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753557:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d504 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753588:0:7991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784657.753609:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753614:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4fd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753620:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753627:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784657.753631:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753638:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4fd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753647:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784657.753650:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787784657.753654:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4fd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753660:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d4fd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753682:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d4ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753687:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d4ef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753692:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d4ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753696:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784657.753699:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d4ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753704:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d4ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753711:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:0.0:1787784657.753713:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784657.753716:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d4ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753721:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d4ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787784657.753729:0:7991:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a30639e7 reply state 0000000042b6ab76 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753739:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.753746:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8950c23c8000) 00010000:00010000:0.0:1787784657.753752:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787784657.753755:0:7991:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787784657.753885:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+34:11363:x1874627728041088:12345-192.168.202.41@tcp:36:rm.0 Request processed in 1136us (1426us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787784657.753894:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 106 00010000:00010000:1.0:1787784657.753989:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784657.754001:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d504 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.754006:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784657.754010:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d504 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.754016:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d504 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.754025:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:1.0:1787784657.754028:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787784657.754031:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d504 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.754035:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d504 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784657.754046:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784657.754047:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784657.754049:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784657.799133:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.799206:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728041344 00000100:00100000:2.0:1787784657.799217:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728041344 00000100:00100000:2.0:1787784657.799393:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 107 00000100:00100000:2.0:1787784657.799404:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+34:11369:x1874627728041344:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784657.799428:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784657.799449:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d50b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72aee expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.799557:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d512 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.799572:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d512 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.799583:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d512 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.799670:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d519 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.799691:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.799699:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787784657.800139:0:11332:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787784657.800246:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d520 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.800256:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d520 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.800417:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d520 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.800447:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d512 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.800451:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d512 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.800456:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d512 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.800459:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784657.800462:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d512 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.800467:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d512 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.800485:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784657.800488:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784657.800491:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d512 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.800495:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d512 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784657.800505:0:11332:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afbd0d68 reply state 00000000b34e4af2 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.800524:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.800528:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8950c23c8000) 00010000:00010000:2.0:1787784657.800529:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784657.800531:0:11332:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787784657.800554:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d50b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aee expref: 37 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.800563:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d520 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aee expref: 36 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.800567:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67200) 00010000:00010000:2.0:1787784657.800569:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784657.800571:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5bc00, rc 0) 00000100:00100000:2.0:1787784657.800696:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+37:11369:x1874627728041344:12345-192.168.202.41@tcp:101:bash.0 Request processed in 1295us (1574us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787784657.800702:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 107 00000100:00100000:3.0:1787784657.803345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.803600:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728041472 00000100:00100000:2.0:1787784657.803609:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728041472 00000100:00100000:2.0:1787784657.803680:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:2.0:1787784657.803691:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff479a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627728041472:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784657.803722:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784657.803746:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009133eb47/0x88ace7295d9d52e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72af5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784657.803804:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784657.803826:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:2.0:1787784657.803831:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784657.803840:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009133eb47/0x88ace7295d9d52e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72af5 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.803860:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009133eb47/0x88ace7295d9d52e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72af5 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.803875:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a800, rc 0) 00000100:00100000:2.0:1787784657.803926:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff479a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627728041472:12345-192.168.202.41@tcp:101:bash.0 Request processed in 237us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.803933:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:3.0:1787784657.806417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784657.816384:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728041600 00000100:00100000:2.0:1787784657.816399:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728041600 00000100:00100000:2.0:1787784657.816477:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:2.0:1787784657.816488:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:11369:x1874627728041600:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784657.816515:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784657.816550:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72afc expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.816586:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009133eb47/0x88ace7295d9d52e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72af5 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.816595:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784657.816599:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784657.816603:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.816639:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009133eb47/0x88ace7295d9d52e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72af5 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.816654:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009133eb47/0x88ace7295d9d52e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72af5 expref: 7 pid: 8437 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784657.816667:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1874627750140416:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784657.816876:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f53eb780 going to sleep for 11 seconds 00000100:00100000:2.0:1787784657.826682:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1874627750140416:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784657.826723:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784657.826743:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5b400, rc 0) 00000100:00100000:2.0:1787784657.826845:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:11369:x1874627728041600:12345-192.168.202.41@tcp:101:bash.0 Request processed in 10358us (20436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.826871:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:3.0:1787784657.827920:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784657.828015:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728041728 00000100:00100000:0.0:1787784657.828024:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728041728 00010000:00010000:0.0:1787784657.828064:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009133eb47/0x88ace7295d9d52e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72af5 expref: 7 pid: 8437 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784657.828106:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:0.0:1787784657.828116:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728041728:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784657.828132:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784657.828152:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009133eb47/0x88ace7295d9d52e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72af5 expref: 7 pid: 8437 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.828277:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009133eb47/0x88ace7295d9d52e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72af5 expref: 7 pid: 8437 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.828369:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009133eb47/0x88ace7295d9d52e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72af5 expref: 7 pid: 8437 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.828387:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784657.828391:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784657.828399:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.828500:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784657.828548:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784657.828563:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1874627750140544:192.168.202.41@tcp:105: 00000100:00100000:0.0:1787784657.828700:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c12549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784657.844988:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784657.845114:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1874627750140544:192.168.202.41@tcp:105: 00010000:00010000:0.0:1787784657.845140:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784657.845207:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728041728:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 17091us (17288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784657.845218:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:1.0:1787784657.845741:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728041984 00000100:00100000:1.0:1787784657.845749:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728041984 00000100:00100000:1.0:1787784657.845833:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:1.0:1787784657.845844:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+37:11369:x1874627728041984:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:1.0:1787784657.846384:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+38:11369:x1874627728041984:12345-192.168.202.41@tcp:35:bash.0 Request processed in 540us (1419us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1787784657.846392:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:3.0:1787784658.054171:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784658.054196:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750140672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784658.054272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784658.054472:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750140672 00000100:00100000:0.0:1787784658.054481:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750140672 00000100:00100000:0.0:1787784658.054547:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787784658.054557:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750140672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784658.054591:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787784658.054634:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750140672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.054640:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787784658.054938:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750140800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784658.054972:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784658.055028:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750140672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784658.055115:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750140800 00000100:00100000:2.0:1787784658.055120:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750140800 00000100:00100000:2.0:1787784658.055179:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787784658.055191:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750140800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784658.055216:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784658.055261:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750140800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.055267:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787784658.055309:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750140800:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787784658.055501:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784658.055899:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750140928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784658.055936:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784658.055997:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750140928 00000100:00100000:1.0:1787784658.056011:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750140928 00000100:00100000:1.0:1787784658.056058:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787784658.056066:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750140928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784658.056079:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787784658.056137:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784658.056551:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750140928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 484us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784658.056558:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787784658.056622:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750140928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784658.072181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784658.073711:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728042112 00000100:00100000:2.0:1787784658.073723:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728042112 00000100:00100000:2.0:1787784658.073835:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 108 00000100:00100000:2.0:1787784658.073846:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+38:11385:x1874627728042112:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784658.073871:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784658.073893:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d53c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b03 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.073978:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d543 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.073992:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.074002:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784658.074057:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787784658.074061:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787784658.074082:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.074106:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d53c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b03 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.074125:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d543 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b03 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.074134:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784658.074136:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784658.074140:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5ba00, rc 0) 00000100:00100000:2.0:1787784658.074208:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+39:11385:x1874627728042112:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 364us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.074216:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 108 00000100:00100000:3.0:1787784658.078021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784658.078072:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728042368 00000100:00100000:2.0:1787784658.078082:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728042368 00000100:00100000:2.0:1787784658.078146:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 109 00000100:00100000:2.0:1787784658.078156:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+39:11385:x1874627728042368:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784658.078178:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784658.078199:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d54a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b0a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.078322:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d551 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.078354:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.078366:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784658.078383:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787784658.078494:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d54a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b0a expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.078525:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d551 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b0a expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.078534:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67200) 00010000:00010000:2.0:1787784658.078537:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784658.078540:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a800, rc 0) 00000100:00100000:2.0:1787784658.078608:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+41:11385:x1874627728042368:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 454us (595us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1787784658.078615:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 109 00000100:00100000:3.0:1787784658.091052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784658.091117:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784658.091348:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728042496 00000100:00100000:0.0:1787784658.091368:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728042496 00000100:00100000:0.0:1787784658.091448:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1787784658.091458:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+41:2407:x1874627728042496:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784658.091473:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784658.091498:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d551 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b0a expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.091531:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67200) 00010000:00010000:0.0:1787784658.091536:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784658.091606:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+40:2407:x1874627728042496:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 149us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.091614:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:2.0:1787784658.092178:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728042752 00000100:00100000:2.0:1787784658.092185:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728042752 00000100:00100000:2.0:1787784658.092234:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 110 00000100:00100000:2.0:1787784658.092244:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff479680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+40:11385:x1874627728042752:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784658.092264:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784658.092280:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d55f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b11 expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.092407:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d566 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.092421:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d566 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.092744:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d566 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784658.092758:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787784658.093185:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d55f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b11 expref: 43 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.093202:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d566 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b11 expref: 42 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.093211:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67200) 00010000:00010000:2.0:1787784658.093214:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787784658.093217:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5b600, rc 0) 00000100:00100000:2.0:1787784658.093278:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff479680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+42:11385:x1874627728042752:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1034us (2159us total) trans 4294967382 rc 0/0 00000100:00100000:2.0:1787784658.094053:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 110 00000100:00100000:3.0:1787784658.107015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784658.107299:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728042880 00000100:00100000:2.0:1787784658.107309:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728042880 00000100:00100000:2.0:1787784658.107388:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:2.0:1787784658.107401:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627728042880:12345-192.168.202.41@tcp:1:lfs.0 00010000:00010000:2.0:1787784658.107446:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.107485:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.107494:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784658.107499:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784658.107513:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.107554:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.107570:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 6 pid: 8436 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784658.107586:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1874627750141056:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784658.107690:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f53eba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784658.111898:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784658.112059:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728043008 00000100:00100000:0.0:1787784658.112068:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728043008 00002000:00100000:0.0:1787784658.112117:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8951ff47de00 x1874627728043008/t0(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:539/0 lens 504/0 e 0 to 0 dl 1787784669 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784658.112129:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8951ff47de00 with x1874627728043008 ext(0->8) 00010000:00010000:0.0:1787784658.112139:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 7 pid: 8436 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.112155:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 7 pid: 8436 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784658.112163:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8951ff47de00 00000100:00100000:0.0:1787784658.112196:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:0.0:1787784658.112206:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2408:x1874627728043008:12345-192.168.202.41@tcp:4:lfs.0 00000100:00100000:2.0:1787784658.112486:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1874627750141056:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784658.112525:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784658.113466:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2408:x1874627728043008:12345-192.168.202.41@tcp:4:lfs.0 Request processed in 1258us (1575us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787784658.113478:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00002000:00100000:0.0:1787784658.113487:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8951ff47de00 x1874627728043008/t4294967303(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:539/0 lens 504/448 e 0 to 0 dl 1787784669 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784658.113497:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8951ff47de00 with x1874627728043008 ext(0->8) 00010000:00010000:0.0:1787784658.113516:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 9 pid: 8436 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.113529:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 9 pid: 8436 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784658.113536:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8951ff47de00 00000100:00100000:3.0:1787784658.122618:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784658.122832:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728043136 00000100:00100000:2.0:1787784658.122842:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728043136 00010000:00010000:2.0:1787784658.122883:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 9 pid: 8436 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784658.122940:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 74 00000100:00100000:2.0:1787784658.122951:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2408:x1874627728043136:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784658.122966:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787784658.122983:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787784658.122986:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787784657 00002000:00010000:2.0:1787784658.122988:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787784658 00002000:00010000:2.0:1787784658.122990:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787784657 00002000:00010000:2.0:1787784658.122992:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787784658.122998:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 9 pid: 8436 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.123012:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 9 pid: 8436 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.123036:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d535 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72afc expref: 9 pid: 8436 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.123052:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784658.123056:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784658.123062:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.123072:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.123274:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784658.123335:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2408:x1874627728043136:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 385us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.123343:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 74 00010000:00010000:3.0:1787784658.127220:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.127239:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.127272:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.127281:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.127289:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.127296:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784658.127300:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.127330:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.127349:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.127357:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe7ba3ac/0x88ace7295d9d574 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784658.128320:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2406:x1874627728042880:12345-192.168.202.41@tcp:1:lfs.0 Request processed in 20915us (21307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784658.128333:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:3.0:1787784658.132071:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784658.132168:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728043392 00000100:00100000:2.0:1787784658.132178:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728043392 00000100:00100000:2.0:1787784658.132239:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:2.0:1787784658.132250:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f0042850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+42:11385:x1874627728043392:12345-192.168.202.41@tcp:35:lfs.0 00000004:00010000:2.0:1787784658.132319:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d566 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b11 expref: 42 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784658.132570:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787784658.132858:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1787784658.133195:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:2.0:1787784658.133235:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.133250:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d520 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aee expref: 46 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.133260:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.133294:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d520 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aee expref: 46 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.133310:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d520 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aee expref: 46 pid: 11332 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784658.133333:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1874627750141184:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784658.133429:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f53eb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784658.136992:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1874627750141184:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784658.137025:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784658.137835:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784658.138061:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728043520 00000100:00100000:0.0:1787784658.138070:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728043520 00010000:00010000:0.0:1787784658.138120:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d520 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aee expref: 47 pid: 11332 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784658.138167:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00100000:0.0:1787784658.138178:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+47:2405:x1874627728043520:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784658.138194:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784658.138201:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d520 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aee expref: 47 pid: 11332 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.138214:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d520 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aee expref: 47 pid: 11332 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.138251:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d520 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72aee expref: 47 pid: 11332 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.138269:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67200) 00010000:00010000:0.0:1787784658.138274:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.138283:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.138291:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.138323:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784658.138375:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+46:2405:x1874627728043520:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 199us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.138384:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 75 00010000:00010000:2.0:1787784658.138526:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.138534:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784658.138634:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:2.0:1787784658.138741:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1787784658.138868:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1874627750141312:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787784658.138910:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.138948:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa994c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784658.139649:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750141312 00000100:00100000:0.0:1787784658.139658:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750141312 00000100:00100000:0.0:1787784658.139721:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787784658.139730:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c780bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1874627750141312:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787784658.139843:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c780bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1874627750141312:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 114us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.139850:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1787784658.140028:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784658.142056:0:6525:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1787784658.142067:0:6525:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:3.0:1787784658.142085:0:6525:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8951c12ad680, transno 4294967302 00000100:00100000:3.0:1787784658.142119:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1874627750141312:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787784658.142532:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:3.0:1787784658.142595:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24b12c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1874627750141440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787784658.142653:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784658.142725:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784658.148103:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750141440 00000100:00100000:0.0:1787784658.148125:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750141440 00000100:00100000:0.0:1787784658.148304:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787784658.148315:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1874627750141440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787784658.148725:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6525:x1874627750141440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 412us (6071us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787784658.148734:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787784658.150569:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24b12c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1874627750141440:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787784658.150661:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1787784658.150721:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.150731:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.150738:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.150756:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784658.150760:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.150792:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.150809:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67200) 00010000:00010000:2.0:1787784658.150813:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787784658.150817:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.150824:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d57b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787784658.151078:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787784658.151152:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1787784658.151439:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398400669955ns, next at 399400667038ns, rc = 0 00000001:00080000:2.0:1787784658.151448:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:2.0:1787784658.151481:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67200) 00010000:00010000:2.0:1787784658.151485:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787784658.151493:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d566 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b11 expref: 50 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784658.151958:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f0042850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+49:11385:x1874627728043392:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 19709us (19896us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787784658.151968:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00000020:00080000:2.0:1787784658.151974:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787784658.167175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784658.167322:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728043648 00000100:00100000:2.0:1787784658.167343:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728043648 00000100:00100000:2.0:1787784658.167400:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 111 00000100:00100000:2.0:1787784658.167410:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+49:11385:x1874627728043648:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784658.167432:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784658.167454:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d582 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b18 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.167522:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d582 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b18 expref: 50 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.167537:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d582 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b18 expref: 50 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.167555:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:2.0:1787784658.167558:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784658.167562:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5bc00, rc 0) 00000100:00100000:2.0:1787784658.167617:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+50:11385:x1874627728043648:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 209us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.167625:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 111 00000100:00100000:1.0:1787784658.170750:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784658.171030:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728043904 00000100:00100000:3.0:1787784658.171040:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728043904 00000100:00100000:3.0:1787784658.171095:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:3.0:1787784658.171128:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+50:11385:x1874627728043904:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1787784658.171588:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+51:11385:x1874627728043904:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 461us (1026us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787784658.171597:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:3.0:1787784658.265033:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784658.265139:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728044032 00000100:00100000:2.0:1787784658.265148:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728044032 00000100:00100000:2.0:1787784658.265214:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 112 00000100:00100000:2.0:1787784658.265225:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+51:11395:x1874627728044032:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:2.0:1787784658.265302:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d589 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265319:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d589 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265347:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d589 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265361:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d590 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265369:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265376:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265450:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d597 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265459:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265466:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784658.265523:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265536:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d589 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265543:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d589 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265549:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d589 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265568:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784658.265572:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d589 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265579:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d589 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265591:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784658.265594:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784658.265598:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d589 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265605:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d589 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265620:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265626:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d590 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265631:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d590 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265636:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784658.265638:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d590 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265643:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d590 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265661:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8950c23c8000) 00010000:00010000:2.0:1787784658.265663:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784658.265666:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d590 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265672:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d590 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265680:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265685:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d597 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265690:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d597 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265694:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784658.265696:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d597 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265701:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d597 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265889:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:2.0:1787784658.265892:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784658.265895:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d597 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.265901:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d597 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784658.266077:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+51:11395:x1874627728044032:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 853us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.266085:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 112 00000100:00100000:0.0:1787784658.357810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784658.357910:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728044288 00000100:00100000:2.0:1787784658.357930:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728044288 00000100:00100000:2.0:1787784658.357990:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 113 00000100:00100000:2.0:1787784658.358000:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+51:11398:x1874627728044288:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784658.358022:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784658.358043:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d59e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b1f expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358131:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358149:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358161:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358172:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d5ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358180:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d5ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358187:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d5ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358322:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d5b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358331:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358339:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784658.358348:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787784658.358423:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358431:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5a5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358438:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358445:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784658.358449:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358457:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358470:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784658.358474:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784658.358478:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358494:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358520:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d5ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358527:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d5ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358534:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d5ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358539:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784658.358543:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d5ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358550:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d5ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358558:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8950c23c8000) 00010000:00010000:2.0:1787784658.358560:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784658.358564:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d5ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358571:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d5ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358604:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d59e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b1f expref: 54 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358616:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b1f expref: 53 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.358630:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:2.0:1787784658.358633:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784658.358635:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a800, rc 0) 00000100:00100000:2.0:1787784658.359159:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+53:11398:x1874627728044288:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1158us (1356us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1787784658.359169:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 113 00000100:00100000:1.0:1787784658.367601:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784658.368308:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728044416 00000100:00100000:0.0:1787784658.368320:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728044416 00000100:00100000:0.0:1787784658.368377:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 114 00000100:00100000:0.0:1787784658.368387:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+53:11398:x1874627728044416:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:0.0:1787784658.368457:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.368475:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.368487:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.368533:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.368541:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.368549:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.368556:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784658.368560:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.368600:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.368614:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:0.0:1787784658.368617:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784658.368621:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.368627:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784658.368715:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+53:11398:x1874627728044416:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 329us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.368723:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 114 00000100:00100000:3.0:1787784658.372968:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784658.373258:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728044672 00000100:00100000:1.0:1787784658.373269:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728044672 00000100:00100000:1.0:1787784658.373334:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:1.0:1787784658.373345:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+53:11398:x1874627728044672:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1787784658.374101:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+54:11398:x1874627728044672:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 755us (1140us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787784658.374110:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00010000:00010000:1.0:1787784658.438644:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784658.540295:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784658.546305:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728044928 00000100:00100000:2.0:1787784658.546320:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728044928 00000100:00100000:0.0:1787784658.546624:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00100000:0.0:1787784658.546638:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+54:11408:x1874627728044928:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1787784658.546666:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784658.546670:0:11332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787784658.546699:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d543 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b03 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.546728:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:0.0:1787784658.546731:0:11332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784658.546743:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b26 expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.547667:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d5cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.547700:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d5cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.547723:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d5cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784658.547735:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787784658.547994:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b26 expref: 56 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.548028:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d5cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b26 expref: 55 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.548037:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:0.0:1787784658.548040:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784658.548044:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629000, rc 0) 00000100:00100000:0.0:1787784658.548131:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+55:11408:x1874627728044928:12345-192.168.202.41@tcp:101:bash.0 Request processed in 1496us (7846us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787784658.548140:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00100000:2.0:1787784658.554539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784658.554629:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784658.554830:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728045184 00000100:00100000:1.0:1787784658.554841:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728045184 00000100:00100000:0.0:1787784658.554869:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728045056 00000100:00100000:0.0:1787784658.554876:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728045056 00000100:00100000:1.0:1787784658.554916:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 116 00000100:00100000:1.0:1787784658.554930:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c78092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+56:11408:x1874627728045184:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1787784658.554955:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784658.554977:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d5dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b2d expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784658.555001:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:0.0:1787784658.555013:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7808b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+57:2408:x1874627728045056:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784658.555028:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784658.555032:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d5e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.555050:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d5cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b26 expref: 57 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.555558:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.555574:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.555695:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d5dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b2d expref: 57 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.555710:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b2d expref: 56 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.555719:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:1.0:1787784658.555722:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787784658.555725:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602800, rc 0) 00000100:00100000:1.0:1787784658.556542:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c78092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+56:11408:x1874627728045184:12345-192.168.202.41@tcp:101:bash.0 Request processed in 1610us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784658.556552:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 116 00010000:00010000:0.0:1787784658.559522:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:0.0:1787784658.559539:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784658.566884:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7808b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+55:2408:x1874627728045056:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 11861us (12343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.566900:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:2.0:1787784658.567556:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750141824:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.567627:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.567678:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750142336:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.567706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.567734:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787784658.567741:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750141696:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.567763:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.567799:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750142208:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.567819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.567844:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750141952:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.567866:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.567883:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750142464:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.567901:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.567921:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787784658.567936:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750141568:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.567964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.567987:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750142080:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.568007:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.568016:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750142592:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.568038:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.568083:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750141568 00000100:00100000:2.0:1787784658.568091:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750141568 00000100:00100000:2.0:1787784658.568152:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1787784658.568364:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750141568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.568420:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750141568:12345-0@lo:400:kworker.0 Request processed in 62us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.568428:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1787784658.568544:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750141568:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.568571:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750142336 00000100:00100000:2.0:1787784658.568576:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750142336 00000100:00100000:2.0:1787784658.568610:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750141696 00000100:00100000:2.0:1787784658.568613:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750141696 00000100:00100000:2.0:1787784658.568625:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787784658.568631:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750142336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.568670:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750142336:12345-0@lo:400:kworker.0 Request processed in 40us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.568677:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787784658.568687:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750142208 00000100:00100000:2.0:1787784658.568690:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750142208 00000100:00100000:2.0:1787784658.568704:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750141952 00000100:00100000:2.0:1787784658.568707:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750141952 00000100:00100000:2.0:1787784658.568732:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750142464 00000100:00100000:2.0:1787784658.568735:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750142464 00000100:00100000:2.0:1787784658.568748:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750142080 00000100:00100000:2.0:1787784658.568750:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750142080 00000100:00100000:2.0:1787784658.568763:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787784658.568796:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750141696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.568827:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750141696:12345-0@lo:400:kworker.0 Request processed in 58us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.568834:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787784658.568846:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787784658.568852:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750142208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.568878:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750142208:12345-0@lo:400:kworker.0 Request processed in 27us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.568883:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787784658.568895:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787784658.568901:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750141952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.568935:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750141952:12345-0@lo:400:kworker.0 Request processed in 35us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.568942:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787784658.568953:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787784658.568960:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750142464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.568985:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750142464:12345-0@lo:400:kworker.0 Request processed in 27us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.568990:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787784658.569001:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1787784658.569007:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750142080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.569045:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750142080:12345-0@lo:400:kworker.0 Request processed in 38us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.569051:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00080000:2.0:1787784658.569068:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784658.569072:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784658.569094:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750141696:0@lo:400:kworker.0 00010000:00080000:2.0:1787784658.569108:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c780ad00 x1874627750142208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784658.569120:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750142208:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.569131:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750142336:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.571306:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750142080:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.571341:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750141952:0@lo:400:kworker.0 00010000:00080000:2.0:1787784658.571356:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d24e30c0 x1874627750142464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784658.571368:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750142464:0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.571624:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784658.571639:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750142720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784658.571695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.571744:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750142720 00000100:00100000:2.0:1787784658.571750:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750142720 00000100:00100000:2.0:1787784658.571822:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787784658.571831:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750142720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787784658.571856:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784658.571912:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750142720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.571919:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1787784658.571940:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784658.571965:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750142720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784658.571999:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750141824 00000100:00100000:2.0:1787784658.572003:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750141824 00000100:00100000:2.0:1787784658.572027:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787784658.572033:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750141824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784658.572073:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750141824:12345-0@lo:400:kworker.0 Request processed in 40us (4446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.572079:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787784658.572106:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750141824:0@lo:400:kworker.0 00000100:00100000:0.0:1787784658.572755:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750142592 00000100:00100000:0.0:1787784658.572760:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750142592 00000100:00100000:0.0:1787784658.572815:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787784658.572823:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750142592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784658.572870:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750142592:12345-0@lo:400:kworker.0 Request processed in 48us (4830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.572876:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787784658.572899:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784658.572907:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750142848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784658.572951:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784658.572981:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750142848 00000100:00100000:0.0:1787784658.572985:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750142848 00000100:00100000:0.0:1787784658.573008:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787784658.573014:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750142848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784658.573025:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784658.573056:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750142848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.573062:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787784658.573090:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750142848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784658.573119:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750142592:0@lo:400:kworker.0 00000100:00100000:3.0:1787784658.580956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784658.581053:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728045440 00000100:00100000:0.0:1787784658.581063:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728045440 00000100:00100000:0.0:1787784658.581132:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 117 00000100:00100000:0.0:1787784658.581143:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+55:11408:x1874627728045440:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:0.0:1787784658.581213:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784658.581240:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d5b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b1f expref: 55 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.581261:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:0.0:1787784658.581266:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784658.581431:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.581445:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.581455:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784658.581498:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:0.0:1787784658.581531:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000484bedf5 reply state 00000000badefb5f transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.581544:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.581550:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:0.0:1787784658.581553:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787784658.581556:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787784658.581652:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+57:11408:x1874627728045440:12345-192.168.202.41@tcp:36:bash.0 Request processed in 511us (706us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1787784658.581668:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 117 00000020:00080000:0.0:1787784658.581673:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787784658.586293:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784658.586565:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728045568 00000100:00100000:2.0:1787784658.586575:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728045568 00000100:00100000:2.0:1787784658.586644:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 118 00000100:00100000:2.0:1787784658.586655:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+57:11408:x1874627728045568:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784658.586680:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784658.586702:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d5f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b34 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.586827:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.586843:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.586854:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784658.586900:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787784658.586904:0:7991:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787784658.586923:0:7991:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.586949:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d5f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b34 expref: 59 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.586968:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b34 expref: 58 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.586976:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:2.0:1787784658.586978:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784658.586982:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5b400, rc 0) 00000100:00100000:2.0:1787784658.587051:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+58:11408:x1874627728045568:12345-192.168.202.41@tcp:101:bash.0 Request processed in 398us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.587058:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 118 00000100:00100000:3.0:1787784658.591660:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784658.592790:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728045824 00000100:00100000:1.0:1787784658.592804:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728045824 00000100:00100000:1.0:1787784658.592866:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:1.0:1787784658.592879:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+58:11408:x1874627728045824:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:1.0:1787784658.593114:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+59:11408:x1874627728045824:12345-192.168.202.41@tcp:35:bash.0 Request processed in 238us (1464us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787784658.593138:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:3.0:1787784658.663663:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784658.663830:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728045952 00000100:00100000:0.0:1787784658.663840:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728045952 00000100:00100000:0.0:1787784658.663907:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:0.0:1787784658.663918:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+59:11414:x1874627728045952:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784658.663943:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784658.663962:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d600 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b3b expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.664028:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d607 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.664041:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d607 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.664052:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d607 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784658.664096:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787784658.664100:0:11332:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784658.664118:0:11332:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d607 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.664141:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d600 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b3b expref: 61 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.664171:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d607 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b3b expref: 60 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.664198:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:0.0:1787784658.664201:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784658.664206:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628c00, rc 0) 00000100:00100000:0.0:1787784658.664489:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+60:11414:x1874627728045952:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 572us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.664496:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:3.0:1787784658.676961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784658.677273:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728046080 00000100:00100000:0.0:1787784658.677284:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728046080 00000100:00100000:0.0:1787784658.677344:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00100000:0.0:1787784658.677354:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+60:11414:x1874627728046080:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784658.677375:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784658.677396:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d60e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b42 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677475:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d615 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677490:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d615 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677511:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d615 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677524:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d61c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677531:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d61c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677557:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d61c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677629:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d623 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677637:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677643:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784658.677687:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787784658.677692:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784658.677710:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677722:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677730:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d615 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677735:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d615 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677742:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d615 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677747:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784658.677751:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d615 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677930:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d615 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677944:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:0.0:1787784658.677948:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784658.677952:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d615 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677958:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d615 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677973:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d61c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677979:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d61c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677985:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d61c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.677990:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784658.677993:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d61c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.678000:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d61c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.678009:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8950c23c8000) 00010000:00010000:0.0:1787784658.678011:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784658.678014:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d61c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.678029:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d61c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.678057:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d60e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b42 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.678069:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d623 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b42 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.678076:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:0.0:1787784658.678079:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784658.678081:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35c00, rc 0) 00000100:00100000:0.0:1787784658.678204:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+61:11414:x1874627728046080:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 850us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.678212:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00100000:2.0:1787784658.688320:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784658.688482:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784658.688587:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728046464 00000100:00100000:1.0:1787784658.688598:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728046464 00000100:00100000:1.0:1787784658.688664:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 121 00000100:00100000:1.0:1787784658.688675:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+61:11414:x1874627728046464:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787784658.688696:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784658.688715:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d62a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b49 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.688872:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.688890:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b34 expref: 62 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.688899:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d623 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b42 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.688908:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.688946:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d623 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b42 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.688957:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d623 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b42 expref: 62 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784658.688970:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47da40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750142976:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784658.689078:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b34 expref: 62 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.689087:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b34 expref: 62 pid: 7991 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784658.689096:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750143104:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784658.689117:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32180 going to sleep for 11 seconds 00010000:00010000:1.0:1787784658.692059:0:6523:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.41@tcp) returned -22 from blocking AST (req@00000000e3d21a99 x1874627750142976) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d623 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b42 expref: 62 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.692086:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d623 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b42 expref: 62 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.692111:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d623 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b42 expref: 62 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784658.692128:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47da40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750142976:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784658.692141:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750143104:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784658.692173:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:1.0:1787784658.692179:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.692188:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.692196:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784658.692408:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728046208 00000100:00100000:0.0:1787784658.692416:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728046208 00000100:00100000:0.0:1787784658.692483:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:0.0:1787784658.692493:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+62:2406:x1874627728046208:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784658.692518:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784658.692521:0:6505:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 88ace7295d9d623) 00010000:00010000:0.0:1787784658.692524:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784658.692586:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+62:2406:x1874627728046208:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 94us (4276us total) trans 0 rc 116/116 00000100:00100000:0.0:1787784658.692594:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:3.0:1787784658.696143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784658.696574:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728046592 00000100:00100000:2.0:1787784658.696584:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728046592 00010000:00010000:2.0:1787784658.696630:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b34 expref: 62 pid: 7991 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784658.696676:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:2.0:1787784658.696686:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+62:2408:x1874627728046592:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784658.696702:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784658.696722:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b34 expref: 62 pid: 7991 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.696735:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b34 expref: 62 pid: 7991 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.696759:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d5f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b34 expref: 62 pid: 7991 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.696828:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:2.0:1787784658.696834:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.696843:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.696850:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.696878:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784658.696926:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+61:2408:x1874627728046592:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 242us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.696933:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 76 00010000:00010000:1.0:1787784658.697578:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.697588:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784658.697606:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787784658.697727:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9d62a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b49 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.697744:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b49 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.697751:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:1.0:1787784658.697753:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787784658.697755:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602200, rc 0) 00000100:00100000:1.0:1787784658.697917:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+61:11414:x1874627728046464:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 9243us (9434us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787784658.697925:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 121 00000100:00100000:3.0:1787784658.702745:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784658.703110:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728046848 00000100:00100000:0.0:1787784658.703135:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728046848 00000100:00100000:0.0:1787784658.703309:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:0.0:1787784658.703320:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+61:11414:x1874627728046848:12345-192.168.202.41@tcp:103:lfs.0 00010000:00010000:0.0:1787784658.703338:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784658.703364:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d582 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b18 expref: 61 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.703396:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:0.0:1787784658.703402:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784658.703470:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+60:11414:x1874627728046848:12345-192.168.202.41@tcp:103:lfs.0 Request processed in 152us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.703479:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:2.0:1787784658.706113:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784658.706207:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728046976 00000100:00100000:3.0:1787784658.706219:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728046976 00000100:00100000:3.0:1787784658.706287:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 122 00000100:00100000:3.0:1787784658.706297:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+60:11414:x1874627728046976:12345-192.168.202.41@tcp:58:lfs.0 00010000:00010000:3.0:1787784658.706414:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d63f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.706431:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d63f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.706453:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d63f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784658.706559:0:11332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787784658.706651:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+60:11414:x1874627728046976:12345-192.168.202.41@tcp:58:lfs.0 Request processed in 355us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784658.706659:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 122 00000100:00100000:3.0:1787784658.710656:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784658.710817:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728047104 00000100:00100000:0.0:1787784658.710827:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728047104 00000100:00100000:0.0:1787784658.710883:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 123 00000100:00100000:0.0:1787784658.710892:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+60:11414:x1874627728047104:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784658.710911:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784658.710933:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34c00/0x88ace7295d9d646 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b50 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.710986:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d63f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.710998:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34c00/0x88ace7295d9d646 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b50 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.711017:0:6521:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d63f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.711047:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34c00/0x88ace7295d9d646 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b50 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.711061:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:0.0:1787784658.711064:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784658.711067:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34c00/0x88ace7295d9d646 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b50 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.711074:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34c00, rc 0) 00000100:00100000:0.0:1787784658.711124:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+61:11414:x1874627728047104:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 233us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.711131:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 123 00000040:00080000:2.0:1787784659.272032:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787784659.272041:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784659.272091:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787784659.272100:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787784659.276689:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e0780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1874627750143232:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787784659.278035:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784659.285782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784659.285946:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728047232 00000100:00100000:0.0:1787784659.285955:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728047232 00000100:00100000:0.0:1787784659.286023:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00100000:0.0:1787784659.286034:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+62:11416:x1874627728047232:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787784659.286064:0:6523:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787784659.286272:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+62:11416:x1874627728047232:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 239us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784659.286281:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00100000:2.0:1787784659.286956:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e0780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1874627750143232:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1787784659.289022:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784659.292649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784659.292764:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728047360 00000100:00100000:2.0:1787784659.292866:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728047360 00000100:00100000:2.0:1787784659.292917:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 125 00000100:00100000:2.0:1787784659.292924:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+61:11416:x1874627728047360:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787784659.292991:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d64d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293007:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d64d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293021:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d64d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293033:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d654 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293038:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d654 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293042:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d654 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293058:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d65b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293063:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293067:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784659.293117:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787784659.293120:0:7991:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787784659.293130:0:7991:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293138:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d64d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293142:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d64d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293231:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d64d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293235:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784659.293238:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d64d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293244:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d64d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293254:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951f5128c00) 00010000:00010000:2.0:1787784659.293256:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784659.293266:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d64d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293270:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b400/0x88ace7295d9d64d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293280:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d654 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293292:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d654 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293299:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d654 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293302:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ba00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784659.293304:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d654 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293307:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d654 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293311:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8951e0a67200) 00010000:00010000:2.0:1787784659.293313:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784659.293314:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d654 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293317:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d654 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293327:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293331:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d65b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293335:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d65b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293337:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784659.293342:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d65b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293347:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d65b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293351:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:2.0:1787784659.293352:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784659.293354:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d65b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.293357:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d65b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784659.294381:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+61:11416:x1874627728047360:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 Request processed in 1452us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784659.294390:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 125 00000100:00100000:3.0:1787784659.300485:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784659.300613:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728047616 00000100:00100000:2.0:1787784659.300620:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728047616 00000100:00100000:2.0:1787784659.300673:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 126 00000100:00100000:2.0:1787784659.300680:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+61:11416:x1874627728047616:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784659.300698:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784659.300717:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d662 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b57 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.300835:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d669 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.300851:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.300880:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784659.300890:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787784659.300953:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.300960:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d669 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.300967:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.300973:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5a800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784659.300977:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.300984:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d669 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.300996:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:2.0:1787784659.300999:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787784659.301004:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d669 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.301011:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d669 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.301046:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d662 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b57 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.301062:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951f5128c00) 00010000:00010000:2.0:1787784659.301064:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784659.301067:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d662 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b57 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.301073:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5bc00, rc 0) 00000100:00100000:2.0:1787784659.301114:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+62:11416:x1874627728047616:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 435us (642us total) trans 4294967400 rc 301/301 00000100:00100000:2.0:1787784659.301119:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 126 00000100:00100000:3.0:1787784659.313984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784659.314388:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728047744 00000100:00100000:0.0:1787784659.314398:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728047744 00000100:00100000:0.0:1787784659.314582:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 127 00000100:00100000:0.0:1787784659.314594:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+62:11416:x1874627728047744:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787784659.314636:0:11332:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787784659.314824:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+62:11416:x1874627728047744:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 231us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784659.314833:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 127 00000100:00100000:3.0:1787784659.323752:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784659.332901:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728048000 00000100:00100000:2.0:1787784659.332918:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728048000 00000100:00100000:2.0:1787784659.332997:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 128 00000100:00100000:2.0:1787784659.333009:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3780f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+62:11416:x1874627728048000:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784659.333031:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784659.333035:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787784659.333062:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d607 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b3b expref: 62 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.333083:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784659.333088:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784659.333103:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d677 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b5e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787784659.333751:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787784659.335083:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d67e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.335114:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.335125:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.337649:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d677 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b5e expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.337682:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d67e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b5e expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.337693:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951e0a67200) 00010000:00010000:2.0:1787784659.337696:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784659.337700:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a800, rc 0) 00000100:00100000:3.0:1787784659.344887:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3780f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+63:11416:x1874627728048000:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 11868us (21131us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787784659.344900:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 128 00000100:00100000:3.0:1787784659.357379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784659.357486:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728048256 00000100:00100000:0.0:1787784659.357505:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728048256 00000100:00100000:0.0:1787784659.357569:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 129 00000100:00100000:0.0:1787784659.357579:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3783840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+63:11416:x1874627728048256:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787784659.357641:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784659.357670:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d67e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b5e expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.357691:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951e0a67200) 00010000:00010000:0.0:1787784659.357702:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784659.357722:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35a00/0x88ace7295d9d68c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.357735:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35a00/0x88ace7295d9d68c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.357745:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35a00/0x88ace7295d9d68c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.357839:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d693 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xee2c1a55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.357848:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xee2c1a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.357855:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xee2c1a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.357936:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35a00/0x88ace7295d9d68c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.357944:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35a00/0x88ace7295d9d68c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.357950:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35a00/0x88ace7295d9d68c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.357956:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784659.357961:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35a00/0x88ace7295d9d68c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.357969:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35a00/0x88ace7295d9d68c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.357978:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:0.0:1787784659.357981:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784659.357985:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35a00/0x88ace7295d9d68c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.357991:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35a00/0x88ace7295d9d68c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.358001:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xee2c1a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.358007:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d693 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xee2c1a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.358012:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d693 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xee2c1a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.358024:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784659.358027:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d693 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xee2c1a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.358033:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d693 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xee2c1a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.358042:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xee2c1a55 (ffff8950c23c8100) 00010000:00010000:0.0:1787784659.358044:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784659.358047:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d693 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xee2c1a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.358053:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35c00/0x88ace7295d9d693 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xee2c1a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784659.358150:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3783840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+62:11416:x1874627728048256:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 571us (788us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787784659.358159:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 129 00000100:00100000:1.0:1787784659.363888:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784659.363978:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728048384 00000100:00100000:3.0:1787784659.363987:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728048384 00000100:00100000:3.0:1787784659.364045:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 130 00000100:00100000:3.0:1787784659.364055:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+62:11416:x1874627728048384:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784659.364076:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784659.364100:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d69a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b65 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.364134:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.364164:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.364177:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.364305:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d69a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b65 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.364325:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b65 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.364333:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951f5138600) 00010000:00010000:3.0:1787784659.364336:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787784659.364339:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713e00, rc 0) 00000100:00100000:3.0:1787784659.364417:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+63:11416:x1874627728048384:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 364us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784659.364425:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 130 00000100:00100000:2.0:1787784659.377062:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784659.377176:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728048640 00000100:00100000:3.0:1787784659.377186:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728048640 00000100:00100000:3.0:1787784659.377248:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 131 00000100:00100000:3.0:1787784659.377259:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+63:11416:x1874627728048640:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787784659.377344:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d6a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.377359:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d6a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.377371:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d6a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784659.377714:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1787784659.377724:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399626955240ns, next at 400626952610ns, rc = 0 00000004:00010000:3.0:1787784659.377814:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca1eafad reply state 000000004d99cbc2 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d6a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.377828:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d6a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.377835:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951f5138600) 00010000:00010000:3.0:1787784659.377838:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787784659.377841:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787784659.377936:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+65:11416:x1874627728048640:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 677us (882us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1787784659.377944:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 131 00000100:00100000:0.0:1787784659.385258:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784659.385416:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728048768 00000100:00100000:3.0:1787784659.385425:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728048768 00000100:00100000:3.0:1787784659.385508:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00100000:3.0:1787784659.385519:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+65:11416:x1874627728048768:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784659.385543:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784659.385564:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d6af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b6c expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.386005:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d6af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b6c expref: 66 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.386023:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d6af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b6c expref: 66 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.386044:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951f5138600) 00010000:00010000:2.0:1787784659.386047:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784659.386051:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712e00, rc 0) 00000100:00100000:2.0:1787784659.386118:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+66:11416:x1874627728048768:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 601us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784659.386125:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00100000:1.0:1787784659.392561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784659.401311:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728048896 00000100:00100000:0.0:1787784659.401329:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728048896 00000100:00100000:0.0:1787784659.401428:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:0.0:1787784659.401441:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2405:x1874627728048896:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787784659.401701:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2405:x1874627728048896:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 262us (9147us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787784659.401709:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00080000:3.0:1787784659.401991:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784659.413028:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784659.413132:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728049152 00000100:00100000:1.0:1787784659.413142:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728049152 00000100:00100000:1.0:1787784659.413202:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:1.0:1787784659.413213:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3781680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+66:11416:x1874627728049152:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787784659.413435:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3781680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+67:11416:x1874627728049152:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 224us (416us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1787784659.413459:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:1.0:1787784659.416913:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784659.425315:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728049408 00000100:00100000:2.0:1787784659.425330:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728049408 00000100:00100000:3.0:1787784659.425999:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 133 00000100:00100000:3.0:1787784659.426011:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+67:11416:x1874627728049408:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787784659.426142:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+67:11416:x1874627728049408:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 132us (9239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784659.427139:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 133 00000100:00100000:3.0:1787784659.430339:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784659.432659:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728049536 00000100:00100000:0.0:1787784659.432691:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728049536 00000100:00100000:1.0:1787784659.435083:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:1.0:1787784659.435107:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3782940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+67:11416:x1874627728049536:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784659.435130:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784659.435164:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d6b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b73 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.435233:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d6bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.435247:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d6bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.435259:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d6bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784659.435304:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787784659.435323:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d6bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.435349:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9d6b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b73 expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.435365:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d6bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b73 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.435374:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951f5138600) 00010000:00010000:1.0:1787784659.435391:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787784659.435395:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602e00, rc 0) 00000100:00100000:1.0:1787784659.435479:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3782940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+68:11416:x1874627728049536:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 374us (5142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784659.435487:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:2.0:1787784659.442445:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784659.442603:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728049664 00000100:00100000:0.0:1787784659.442614:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728049664 00000100:00100000:0.0:1787784659.442675:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:0.0:1787784659.442687:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2406:x1874627728049664:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784659.442706:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784659.442726:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9d6c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b7a expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784659.442752:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6dd3, blocks: 0x0 00010000:00010000:0.0:1787784659.442800:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1787784659.442805:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784659.442815:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9d6c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b7a expref: 10 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.442834:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9d6c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b7a expref: 10 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.442848:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628400, rc 0) 00000100:00100000:0.0:1787784659.442911:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+10:2406:x1874627728049664:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 227us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784659.442919:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:0.0:1787784659.449266:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784659.449608:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728049920 00000100:00100000:2.0:1787784659.449618:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728049920 00000100:00100000:2.0:1787784659.449690:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00100000:2.0:1787784659.449702:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+68:11416:x1874627728049920:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787784659.449867:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+68:11416:x1874627728049920:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 167us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784659.449876:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00100000:3.0:1787784659.458873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784659.458923:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728050048 00000100:00100000:0.0:1787784659.458933:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728050048 00000100:00100000:0.0:1787784659.458996:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:0.0:1787784659.459007:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3783c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+10:11416:x1874627728050048:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784659.459038:0:8916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784659.459056:0:8916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c622ec1/0x88ace7295d9d6cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b81 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.459090:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9d6c4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b7a expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.459099:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784659.459104:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784659.459109:0:8916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c622ec1/0x88ace7295d9d6cb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b81 expref: 11 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.459144:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9d6c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b7a expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.459158:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9d6c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b7a expref: 11 pid: 8438 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784659.459171:0:8916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750143360:192.168.202.41@tcp:104: 00000100:00100000:0.0:1787784659.459279:0:8916:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8939780 going to sleep for 11 seconds 00010000:00010000:2.0:1787784659.462896:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784659.463382:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784659.463606:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728050176 00000100:00100000:2.0:1787784659.463614:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728050176 00010000:00010000:2.0:1787784659.463664:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9d6c4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b7a expref: 12 pid: 8438 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784659.463711:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 77 00000100:00100000:2.0:1787784659.463722:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3780b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+12:2405:x1874627728050176:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784659.463760:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784659.463929:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9d6c4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b7a expref: 12 pid: 8438 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.463945:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9d6c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b7a expref: 12 pid: 8438 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.463971:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784659.463976:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784659.463992:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c622ec1/0x88ace7295d9d6cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b81 expref: 12 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.464004:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c622ec1/0x88ace7295d9d6cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b81 expref: 12 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.464045:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009c622ec1/0x88ace7295d9d6cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b81 expref: 12 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784659.464060:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e03c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1874627750143488:192.168.202.41@tcp:105: 00010000:00010000:0.0:1787784659.464232:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9d6c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b7a expref: 12 pid: 8438 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784659.464248:0:8916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750143360:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784659.464274:0:8916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c622ec1/0x88ace7295d9d6cb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b81 expref: 11 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.464294:0:8916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628800, rc 0) 00000100:00100000:2.0:1787784659.464353:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784659.470673:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3783c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+11:11416:x1874627728050048:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 11654us (11799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784659.470688:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:1.0:1787784659.479883:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784659.480540:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e03c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1874627750143488:192.168.202.41@tcp:105: 00010000:00010000:3.0:1787784659.480566:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784659.480605:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728050304 00000100:00100000:0.0:1787784659.480613:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728050304 00002000:00100000:0.0:1787784659.480663:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8951ff47c3c0 x1874627728050304/t0(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:540/0 lens 504/0 e 0 to 0 dl 1787784670 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784659.480674:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8951ff47c3c0 with x1874627728050304 ext(0->12) 00002000:00010000:0.0:1787784659.480679:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8951ff47c3c0 00000100:00100000:0.0:1787784659.480716:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:0.0:1787784659.480726:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+11:2405:x1874627728050304:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787784659.480918:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3780b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+11:2405:x1874627728050176:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 17197us (17542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784659.480928:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 77 00000100:00100000:0.0:1787784659.483190:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+12:2405:x1874627728050304:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 Request processed in 2455us (3306us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787784659.483205:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00002000:00100000:0.0:1787784659.483219:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8951ff47c3c0 x1874627728050304/t4294967309(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:540/0 lens 504/448 e 0 to 0 dl 1787784670 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784659.483230:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8951ff47c3c0 with x1874627728050304 ext(0->12) 00002000:00010000:0.0:1787784659.483236:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8951ff47c3c0 00000100:00100000:1.0:1787784659.486431:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784659.486680:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728050432 00000100:00100000:3.0:1787784659.486690:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728050432 00000100:00100000:3.0:1787784659.487003:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 136 00000100:00100000:3.0:1787784659.487015:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+68:11416:x1874627728050432:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787784659.489707:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:0.0:1787784659.489726:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787784659.489763:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:2.0:1787784659.490147:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784659.490168:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750143872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787784659.490246:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787784659.490269:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8950c3685900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787784659.490284:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8950c25aba00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8950c36853c0 00000020:00080000:0.0:1787784659.490288:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8950c25ab800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8951c7ea2600 00000020:00080000:2.0:1787784659.490311:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:0.0:1787784659.490317:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787784659.490351:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8951c78f5000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787784659.490354:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8951fbe58c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8951c78f5180 00000020:00080000:0.0:1787784659.490357:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8951fbe58000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8951c2b9e400 00000020:00080000:2.0:1787784659.490404:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787784659.490467:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787784659.490472:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750143616:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787784659.490524:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784659.490546:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784659.490552:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750143744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787784659.490572:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784659.490676:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11416:x1874627728050432:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 Request processed in 3661us (4253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784659.490687:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 136 00010000:00010000:3.0:1787784659.490810:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d3d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.490821:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d3d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.490829:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d3d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.490835:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784659.490840:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d3d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.490848:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d3d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.490864:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8951c3a5b200) 00010000:00010000:3.0:1787784659.490874:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784659.490881:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d3d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.490888:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d3d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.490913:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d478 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.490919:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d478 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.490925:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d478 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.490930:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5a000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784659.490933:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d478 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.490939:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d478 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.490947:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:3.0:1787784659.490949:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784659.490952:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d478 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491063:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d478 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491081:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491103:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491109:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491114:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784659.491117:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491122:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491131:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8950c23c8000) 00010000:00010000:3.0:1787784659.491134:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784659.491137:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4f6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491144:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d4f6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491157:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491163:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d519 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491170:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491175:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ac00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784659.491184:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491190:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d519 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491198:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8950c23c8000) 00010000:00010000:3.0:1787784659.491201:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784659.491204:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d519 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491210:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d519 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491226:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491232:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491239:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491244:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784659.491247:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491252:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491259:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:3.0:1787784659.491262:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784659.491269:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5eb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491276:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d5eb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491288:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d6a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491293:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d6a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491299:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d6a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491304:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784659.491307:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d6a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491314:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d6a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491321:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951f5138600) 00010000:00010000:3.0:1787784659.491324:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787784659.491327:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d6a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.491333:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d6a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784659.491687:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750143872 00000100:00100000:2.0:1787784659.491696:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750143872 00000100:00100000:2.0:1787784659.491743:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750143616 00000100:00100000:2.0:1787784659.491747:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750143616 00000100:00100000:2.0:1787784659.491759:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750143744 00000100:00100000:2.0:1787784659.491761:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750143744 00000100:00100000:2.0:1787784659.492047:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787784659.492059:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750143872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787784659.492084:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1787784659.492113:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f6dd1, atime: 0x6a8f6dd2, ctime: 0x6a8f6dd1, blocks: 0x8 00010000:00010000:2.0:1787784659.492120:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d6d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.492141:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:2.0:1787784659.492145:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784659.492152:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d6d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.492167:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d6d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.492176:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d6d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.492183:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d6d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.492202:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787784659.492360:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1874627750143872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 303us (2113us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787784659.492367:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787784659.492383:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787784659.492390:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1874627750143616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787784659.492403:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1787784659.492416:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.492431:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ad9 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784659.492623:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787784659.492633:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1874627750143744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787784659.492711:0:8916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787784659.492720:0:8916:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787784659 00002000:00010000:3.0:1787784659.492723:0:8916:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787784659.492725:0:8916:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787784659 -> 1787784659 00002000:00010000:3.0:1787784659.492728:0:8916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787784659.492765:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3644:x1874627750143744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (2191us total) trans 4294967310 rc 0/0 00010000:00010000:2.0:1787784659.493033:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787784659.493037:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784659.493041:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.493073:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d486 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ad9 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.493089:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d486 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ad9 expref: 11 pid: 8436 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784659.493103:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1874627750144000:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784659.493164:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95b540 going to sleep for 11 seconds 00010000:00010000:2.0:1787784659.493180:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784659.493185:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d6d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.493193:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784659.493197:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d6d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.493206:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d6d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.493234:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d6d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.493243:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000115e9d7/0x88ace7295d9d6d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.493263:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784659.493265:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784659.493267:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787784659.493298:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8951d24e2580/2, rc 0, transno 4294967305 00000100:00100000:2.0:1787784659.493304:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750143872:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787784659.493944:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1787784659.494066:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8951ff47e1c0/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787784659.494072:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750143744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787784659.497137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784659.497284:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728050560 00000100:00100000:2.0:1787784659.497295:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728050560 00000100:00100000:2.0:1787784659.497346:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:2.0:1787784659.497357:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c37812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+12:2405:x1874627728050560:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787784659.499704:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1874627750144000:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784659.499738:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787784659.504892:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1787784659.504908:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1787784659.505160:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c37812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728050560:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 Request processed in 7798us (8029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784659.505172:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:3.0:1787784659.506931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784659.507066:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728050688 00000100:00100000:1.0:1787784659.507075:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728050688 00010000:00010000:1.0:1787784659.507114:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d486 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ad9 expref: 7 pid: 8436 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784659.507156:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:1.0:1787784659.507165:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3781e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728050688:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784659.507182:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784659.507188:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d486 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ad9 expref: 7 pid: 8436 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.507202:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d486 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ad9 expref: 7 pid: 8436 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.507226:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000035c81f5/0x88ace7295d9d486 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ad9 expref: 7 pid: 8436 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.507263:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787784659.507268:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787784659.507274:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.507285:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.507326:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784659.507386:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.507397:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.507406:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.507420:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.507451:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784659.508001:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784659.508009:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.508019:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784659.508023:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.508033:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.508054:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.508062:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025c69831/0x88ace7295d9d6d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.508081:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784659.508083:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784659.508084:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784659.508196:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3781e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728050688:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 1029us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784659.508205:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:2.0:1787784659.508628:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750143616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16237us (18102us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787784659.508637:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787784659.508857:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787784659.508864:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1787784659.508883:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8951ff47e1c0, transno 4294967310 00000100:00100000:0.0:1787784659.508903:0:3644:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8951ff47f0c0 x1874627750143616/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787784675 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787784659.508919:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8951ff47f0c0/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787784659.508922:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784659.508924:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750143616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787784659.508945:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728050944 00000100:00100000:1.0:1787784659.508951:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728050944 00000100:00100000:1.0:1787784659.509063:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 137 00000100:00100000:1.0:1787784659.509073:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+16:11416:x1874627728050944:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787784659.509121:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784659.509142:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d6bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b73 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.509233:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951f5138600) 00010000:00010000:1.0:1787784659.509239:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784659.509266:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d6e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.509292:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.509303:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784659.509418:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b87e2053 reply state 000000004db050e9 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.509430:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d6e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.509447:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951f5138600) 00010000:00010000:1.0:1787784659.509451:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787784659.509453:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784659.509541:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+17:11416:x1874627728050944:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 469us (617us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1787784659.509548:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 137 00000100:00100000:0.0:1787784659.517940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784659.518121:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728051072 00000100:00100000:2.0:1787784659.518133:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728051072 00000100:00100000:2.0:1787784659.518193:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:2.0:1787784659.518201:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627728051072:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787784659.518330:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787784659.518335:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1787784659 -> 1787784658 00002000:00010000:2.0:1787784659.518337:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787784658 00002000:00010000:2.0:1787784659.518339:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787784659 -> 1787784658 00002000:00010000:2.0:1787784659.518341:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787784659.518405:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2406:x1874627728051072:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 205us (476us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787784659.518412:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:2.0:1787784659.532392:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784659.532570:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728051328 00000100:00100000:0.0:1787784659.532580:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728051328 00000100:00100000:0.0:1787784659.532647:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 138 00000100:00100000:0.0:1787784659.532657:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+17:11416:x1874627728051328:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787784659.532727:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.532757:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b65 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.532794:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.532829:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b65 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.532845:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b65 expref: 17 pid: 6522 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784659.532860:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47b840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750144128:192.168.202.41@tcp:104: 00000100:00100000:0.0:1787784659.532941:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8939780 going to sleep for 11 seconds 00000100:00100000:1.0:1787784659.537615:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47b840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750144128:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784659.537646:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784659.538106:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784659.539176:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728051456 00000100:00100000:3.0:1787784659.539190:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728051456 00010000:00010000:3.0:1787784659.539243:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b65 expref: 18 pid: 6522 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784659.539295:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00100000:3.0:1787784659.539309:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cfebc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+18:2405:x1874627728051456:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784659.539332:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784659.539340:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b65 expref: 18 pid: 6522 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.539356:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b65 expref: 18 pid: 6522 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.539387:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b65 expref: 18 pid: 6522 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.539430:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951f5138600) 00010000:00010000:3.0:1787784659.539570:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.539582:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.539590:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.539629:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784659.539713:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cfebc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+17:2405:x1874627728051456:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 406us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784659.539721:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 79 00010000:00010000:1.0:1787784659.539933:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.539941:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.539977:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.539991:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.539999:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.540004:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784659.540009:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.540016:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.540027:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951f5138600) 00010000:00010000:1.0:1787784659.540030:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787784659.540034:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784659.540039:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d6e7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784659.540081:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+16:11416:x1874627728051328:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 Request processed in 7425us (7699us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787784659.540089:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 138 00000100:00100000:0.0:1787784659.546649:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784659.550571:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728051584 00000100:00100000:2.0:1787784659.550587:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728051584 00000100:00100000:2.0:1787784659.550673:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:2.0:1787784659.550697:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2406:x1874627728051584:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787784659.550759:0:8916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.551219:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c622ec1/0x88ace7295d9d6cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b81 expref: 7 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.551231:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784659.551236:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784659.551242:0:8916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.551281:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c622ec1/0x88ace7295d9d6cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b81 expref: 7 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.551296:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c622ec1/0x88ace7295d9d6cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b81 expref: 7 pid: 8916 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784659.551312:0:8916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750144256:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784659.552321:0:8916:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784659.566592:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784659.570083:0:8916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750144256:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784659.570117:0:8916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784659.574280:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728051712 00000100:00100000:3.0:1787784659.574296:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728051712 00010000:00010000:3.0:1787784659.574350:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c622ec1/0x88ace7295d9d6cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b81 expref: 8 pid: 8916 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784659.574605:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 80 00000100:00100000:3.0:1787784659.574617:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2405:x1874627728051712:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784659.574635:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784659.574658:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c622ec1/0x88ace7295d9d6cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b81 expref: 8 pid: 8916 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.574673:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c622ec1/0x88ace7295d9d6cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b81 expref: 8 pid: 8916 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.574719:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c622ec1/0x88ace7295d9d6cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b81 expref: 8 pid: 8916 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.574739:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784659.574743:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784659.574749:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.574759:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.574856:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784659.574915:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728051712:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 300us (8334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784659.574923:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 80 00010000:00010000:0.0:1787784659.576964:0:8916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.576984:0:8916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.577013:0:8916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.577023:0:8916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.577048:0:8916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.577056:0:8916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5bc00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784659.577060:0:8916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.577070:0:8916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.577088:0:8916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.577096:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dca78fb7/0x88ace7295d9d6ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784659.577195:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627728051584:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 Request processed in 26499us (30553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784659.577204:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:1.0:1787784659.588065:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784659.588299:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728051968 00000100:00100000:3.0:1787784659.588309:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728051968 00000100:00100000:3.0:1787784659.588378:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 139 00000100:00100000:3.0:1787784659.588388:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+16:11416:x1874627728051968:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787784659.588476:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.588501:0:7991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d5e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b2d expref: 16 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.588512:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.588561:0:7991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b2d expref: 16 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.588575:0:7991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d5e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b2d expref: 16 pid: 7991 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784659.588590:0:7991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3780b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7991:1874627750144384:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787784659.588669:0:7991:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784659.599986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784659.601075:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728052096 00000100:00100000:3.0:1787784659.601087:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728052096 00010000:00010000:3.0:1787784659.601145:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d5e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b2d expref: 17 pid: 7991 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784659.601195:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 81 00000100:00100000:3.0:1787784659.601206:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+17:2406:x1874627728052096:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784659.601222:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784659.601229:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d5e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b2d expref: 17 pid: 7991 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.601244:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d5e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b2d expref: 17 pid: 7991 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.601266:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:3.0:1787784659.601273:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34c00/0x88ace7295d9d646 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b50 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.601303:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.601312:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.601321:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.601340:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784659.601403:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+17:2406:x1874627728052096:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 198us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784659.601411:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 81 00010000:00010000:2.0:1787784659.606326:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d5e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b2d expref: 16 pid: 7991 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784659.606379:0:7991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3780b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7991:1874627750144384:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784659.606403:0:7991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.606413:0:7991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.606419:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.607272:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.607290:0:7991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d6af lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b6c expref: 16 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.607299:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.607338:0:7991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d6af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b6c expref: 16 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.607354:0:7991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d6af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b6c expref: 16 pid: 11332 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784659.607367:0:7991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7991:1874627750144512:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784659.607588:0:7991:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784659.624953:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784659.625037:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728052224 00000100:00100000:3.0:1787784659.625047:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728052224 00010000:00010000:3.0:1787784659.625090:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d6af lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b6c expref: 17 pid: 11332 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784659.625138:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 82 00000100:00100000:3.0:1787784659.625158:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+17:2405:x1874627728052224:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784659.625176:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784659.625183:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d6af lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b6c expref: 17 pid: 11332 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.625197:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d6af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b6c expref: 17 pid: 11332 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.625241:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951f5138600) 00010000:00010000:3.0:1787784659.625247:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.625256:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.625265:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.625286:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784659.625343:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+17:2405:x1874627728052224:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 195us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784659.625351:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 82 00010000:00010000:2.0:1787784659.626325:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d6af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b6c expref: 16 pid: 11332 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784659.626356:0:7991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7991:1874627750144512:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784659.626380:0:7991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.626389:0:7991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.626394:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784659.626539:0:7991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1787784659.626651:0:7991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:2.0:1787784659.626689:0:7991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1787784659.626836:0:7991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7991:1874627750144640:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787784659.626894:0:7991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784659.626930:0:7991:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784659.627102:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750144640 00000100:00100000:3.0:1787784659.627108:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750144640 00000100:00100000:3.0:1787784659.627159:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787784659.627168:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7991:x1874627750144640:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787784659.627248:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7991:x1874627750144640:12345-0@lo:1000:mdt00_003.0 Request processed in 80us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784659.627255:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787784659.627580:0:7991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7991:1874627750144640:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787784659.627686:0:7991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:2.0:1787784659.627724:0:7991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7991:1874627750144768:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787784659.627751:0:7991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784659.627888:0:7991:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f0216b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784659.627955:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750144768 00000100:00100000:3.0:1787784659.627960:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750144768 00000100:00100000:3.0:1787784659.627992:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787784659.627998:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7991:x1874627750144768:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787784659.628118:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7991:x1874627750144768:12345-0@lo:1000:mdt00_003.0 Request processed in 119us (366us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787784659.628134:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787784659.628309:0:7991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7991:1874627750144768:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787784659.628343:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628352:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628370:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628377:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5a800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784659.628381:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628388:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628404:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951f5138600) 00010000:00010000:2.0:1787784659.628408:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784659.628413:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628420:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d6fc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628519:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d63f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628528:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d63f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628534:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d63f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628540:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784659.628544:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d63f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628561:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d63f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628570:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:2.0:1787784659.628572:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784659.628578:0:7991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34c00/0x88ace7295d9d646 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b50 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628589:0:7991:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34c00/0x88ace7295d9d646 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b50 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628598:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34c00/0x88ace7295d9d646 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b50 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.628623:0:7991:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34c00/0x88ace7295d9d646 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b50 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784659.628634:0:7991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7991:1874627750144896:192.168.202.41@tcp:105: 00000100:00100000:2.0:1787784659.628738:0:7991:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784659.635356:0:7991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7991:1874627750144896:192.168.202.41@tcp:105: 00010000:00010000:2.0:1787784659.635389:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d63f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635401:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d63f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635444:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d703 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635472:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d703 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635485:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d703 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635504:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d703 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635510:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d703 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635517:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d703 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635522:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5bc00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784659.635526:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d703 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635545:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d703 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635556:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:2.0:1787784659.635559:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784659.635563:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d703 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635569:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d703 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635581:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635593:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635598:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635603:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784659.635606:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635612:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635620:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:2.0:1787784659.635622:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787784659.635625:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.635631:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d6f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784659.636476:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+19:11416:x1874627728051968:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 48084us (48414us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787784659.636488:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 139 00000020:00080000:2.0:1787784659.636504:0:7991:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787784659.637098:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787784659.637104:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784659.637658:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787784659.637669:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787784659.641288:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784659.646068:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728052352 00000100:00100000:3.0:1787784659.646083:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728052352 00000100:00100000:1.0:1787784659.646378:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784659.649425:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728052608 00000100:00100000:3.0:1787784659.649451:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728052608 00000100:00100000:3.0:1787784659.649537:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:3.0:1787784659.649548:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f0043450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+20:11416:x1874627728052608:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787784659.649870:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787784659.649904:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:3.0:1787784659.649949:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d70a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.649967:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d70a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.649978:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d70a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.649986:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d70a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.649993:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d70a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.649999:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d70a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784659.657396:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:2.0:1787784659.657423:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11414:x1874627728052352:12345-192.168.202.41@tcp:49:lfs.0 00000100:00100000:2.0:1787784659.657592:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11414:x1874627728052352:12345-192.168.202.41@tcp:49:lfs.0 Request processed in 183us (16314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784659.657619:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 32 00010000:00010000:3.0:1787784659.658514:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787784659.658600:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f0043450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+21:11416:x1874627728052608:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 9050us (12223us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787784659.658623:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000020:00080000:3.0:1787784659.658628:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787784659.660314:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784659.660327:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d70a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.660338:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784659.660342:0:10397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d70a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.660353:0:10397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d70a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.660370:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951f5138600) 00010000:00010000:2.0:1787784659.660373:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787784659.660377:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d70a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.660384:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d70a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.660873:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784659.660875:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784659.660877:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784659.663266:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784659.663396:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728052864 00000100:00100000:2.0:1787784659.663406:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728052864 00000100:00100000:2.0:1787784659.663478:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00100000:2.0:1787784659.663500:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+21:11414:x1874627728052864:12345-192.168.202.41@tcp:58:lfs.0 00000040:00080000:2.0:1787784659.663668:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787784659.663754:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+21:11414:x1874627728052864:12345-192.168.202.41@tcp:58:lfs.0 Request processed in 267us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784659.663813:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00100000:1.0:1787784659.730390:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784659.730697:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728052992 00000100:00100000:0.0:1787784659.730708:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728052992 00000100:00100000:0.0:1787784659.730831:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 141 00000100:00100000:0.0:1787784659.730843:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+21:11418:x1874627728052992:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784659.730870:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784659.730891:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d711 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b88 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.730963:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d718 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.730979:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d718 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.730990:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d718 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.731006:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d71f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.731014:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d71f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.731021:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d71f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.731098:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d726 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.731110:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b49 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.731119:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d726 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.731530:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b49 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784659.731549:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b49 expref: 22 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784659.731563:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750145024:192.168.202.41@tcp:104: 00000100:00100000:0.0:1787784659.731664:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8939cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784659.740357:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784659.740553:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728053248 00000100:00100000:2.0:1787784659.740562:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728053248 00000100:00100000:2.0:1787784659.740620:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:2.0:1787784659.740630:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+23:6178:x1874627728053248:12345-192.168.202.41@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787784659.741247:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750145024:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784659.741274:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d726 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784659.744695:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+24:6178:x1874627728053248:12345-192.168.202.41@tcp:35:ldlm_bl.0 Request processed in 4056us (4338us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787784659.744709:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:1.0:1787784659.750931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784659.751500:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728053376 00000100:00100000:3.0:1787784659.751513:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728053376 00010000:00010000:3.0:1787784659.751560:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b49 expref: 24 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784659.751668:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:3.0:1787784659.751680:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+24:2408:x1874627728053376:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784659.751697:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784659.751705:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b49 expref: 24 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.751719:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b49 expref: 24 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.751742:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9d631 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b49 expref: 24 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.751760:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:3.0:1787784659.751823:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d726 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.751834:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.751842:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d726 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784659.751893:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784659.751947:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+23:2408:x1874627728053376:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 268us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784659.751955:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 83 00010000:00010000:2.0:1787784659.754215:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754231:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784659.754301:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787784659.754306:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787784659.754330:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754346:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754355:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d718 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754374:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d718 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754382:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d718 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754388:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784659.754392:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d718 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754416:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d718 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754430:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:2.0:1787784659.754442:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784659.754447:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d718 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754453:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d718 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754470:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d71f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754476:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d71f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754481:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d71f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754487:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784659.754499:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d71f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754505:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d71f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754513:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8950c23c7100) 00010000:00010000:2.0:1787784659.754516:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784659.754519:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d71f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754536:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d71f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754581:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d711 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b88 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754598:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d726 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b88 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784659.754606:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:2.0:1787784659.754609:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784659.754612:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629c00, rc 0) 00000100:00100000:2.0:1787784659.754694:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11418:x1874627728052992:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 23853us (24315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784659.754704:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 141 00000100:00100000:1.0:1787784660.107289:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750145152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784660.107383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784660.107589:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750145152 00000100:00100000:0.0:1787784660.107598:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750145152 00000100:00100000:0.0:1787784660.107657:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787784660.107667:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750145152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784660.107702:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787784660.107761:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750145152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784660.107792:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787784660.107840:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750145152:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787784660.486061:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784660.683810:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787784660.683820:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784660.683863:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787784660.683872:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787784660.684028:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1874627750145280:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787784660.687317:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3631000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784660.697583:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1874627750145280:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787784660.697760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784660.697920:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728053504 00000100:00100000:2.0:1787784660.697927:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728053504 00000100:00100000:2.0:1787784660.698051:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:2.0:1787784660.698061:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c37952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11429:x1874627728053504:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787784660.698106:0:7991:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787784660.698695:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c37952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11429:x1874627728053504:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 633us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784660.698705:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:1.0:1787784660.716257:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784660.716520:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728053760 00000100:00100000:3.0:1787784660.716531:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728053760 00000100:00100000:3.0:1787784660.716666:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:3.0:1787784660.716677:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+22:11429:x1874627728053760:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784660.716698:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784660.716717:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d72d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b8f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784660.716840:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d734 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784660.716854:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784660.716866:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784660.716876:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787784660.717071:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d72d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b8f expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784660.717090:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b8f expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784660.717110:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:3.0:1787784660.717113:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784660.717117:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712400, rc 0) 00000100:00100000:3.0:1787784660.717179:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+24:11429:x1874627728053760:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 503us (931us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787784660.717186:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:3.0:1787784660.724709:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784660.724968:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728053888 00000100:00100000:1.0:1787784660.724978:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728053888 00000100:00100000:1.0:1787784660.725046:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:1.0:1787784660.725056:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3781680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+24:2407:x1874627728053888:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784660.725072:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784660.725096:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d734 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b8f expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784660.725112:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:1.0:1787784660.725117:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784660.725188:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3781680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+23:2407:x1874627728053888:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 132us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784660.725195:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:1.0:1787784660.731322:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784660.731475:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728054144 00000100:00100000:2.0:1787784660.731494:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728054144 00000100:00100000:2.0:1787784660.731564:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 144 00000100:00100000:2.0:1787784660.731576:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+23:11429:x1874627728054144:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787784660.731655:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d742 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784660.731673:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784660.731685:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784660.731895:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784660.731903:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d742 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784660.731910:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d742 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784660.731916:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5a800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784660.731920:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d742 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784660.731938:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d742 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784660.732213:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:2.0:1787784660.732216:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787784660.732221:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d742 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784660.732228:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d742 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784660.732449:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+24:11429:x1874627728054144:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 874us (1134us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787784660.732458:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 144 00000040:00080000:0.0:1787784660.734978:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787784660.734997:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784660.735457:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787784660.735467:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784660.737383:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784660.737456:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728054400 00000100:00100000:0.0:1787784660.737466:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728054400 00000100:00100000:0.0:1787784660.737713:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:0.0:1787784660.737724:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3781e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+24:11429:x1874627728054400:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787784660.737979:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3781e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+25:11429:x1874627728054400:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 255us (604us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787784660.737988:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000040:00080000:2.0:1787784660.885824:0:14325:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787784660.885834:0:14325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784660.885867:0:14325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787784660.885876:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784661.172497:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784661.173953:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728054656 00000100:00100000:1.0:1787784661.173967:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728054656 00000100:00100000:1.0:1787784661.174070:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00100000:1.0:1787784661.174084:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+25:11442:x1874627728054656:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787784661.174126:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784661.174158:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d749 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b96 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784661.174267:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d750 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784661.174294:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d750 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784661.174307:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d750 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784661.174317:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787784661.174420:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d749 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b96 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784661.174440:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d750 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b96 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784661.174449:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:1.0:1787784661.174452:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787784661.174455:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603c00, rc 0) 00000100:00100000:1.0:1787784661.174531:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+27:11442:x1874627728054656:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 450us (2055us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787784661.174539:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00080000:2.0:1787784661.175926:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784661.184230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784661.184343:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728054784 00000100:00100000:0.0:1787784661.184353:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728054784 00000100:00100000:0.0:1787784661.184418:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 146 00000100:00100000:0.0:1787784661.184429:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+27:11442:x1874627728054784:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:0.0:1787784661.184507:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d75e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784661.184526:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d75e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784661.184538:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d75e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784661.184573:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d75e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784661.184581:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d75e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784661.184589:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d75e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784661.184609:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784661.184613:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d75e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784661.184621:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d75e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784661.184633:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:0.0:1787784661.184637:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784661.184642:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d75e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784661.184648:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d75e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784661.184725:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+27:11442:x1874627728054784:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 297us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784661.184733:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 146 00000100:00100000:1.0:1787784661.323658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784661.323830:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728054912 00000100:00100000:2.0:1787784661.323840:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728054912 00000100:00100000:2.0:1787784661.323929:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:2.0:1787784661.323943:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3795a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728054912:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:2.0:1787784661.323962:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784661.323983:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000115e9d7/0x88ace7295d9d765 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72b9d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784661.324008:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f6dd2, atime: 0x6a8f6dd2, ctime: 0x6a8f6dd2, blocks: 0x8 00010000:00010000:2.0:1787784661.324043:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=401s v=(0 0) 00010000:00010000:2.0:1787784661.324049:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784661.324059:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000115e9d7/0x88ace7295d9d765 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b9d expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784661.324080:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000115e9d7/0x88ace7295d9d765 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b9d expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784661.324095:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5b400, rc 0) 00000100:00100000:2.0:1787784661.324162:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3795a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728054912:12345-192.168.202.41@tcp:101:cat.0 Request processed in 224us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784661.324169:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00080000:3.0:1787784661.324337:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784661.328713:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784661.328854:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728055040 00000100:00100000:0.0:1787784661.328865:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728055040 00002000:00100000:0.0:1787784661.328930:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8950c3782d00 x1874627728055040/t0(0) o3->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:542/0 lens 488/0 e 0 to 0 dl 1787784672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784661.328942:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c3782d00 with x1874627728055040 ext(0->4095) 00002000:00010000:0.0:1787784661.328948:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c3782d00 00000100:00100000:0.0:1787784661.328984:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:0.0:1787784661.328994:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3782d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2406:x1874627728055040:12345-192.168.202.41@tcp:3:cat.0 00000100:00100000:0.0:1787784661.329181:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3782d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2406:x1874627728055040:12345-192.168.202.41@tcp:3:cat.0 Request processed in 188us (477us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787784661.329204:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00002000:00100000:0.0:1787784661.329212:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8950c3782d00 x1874627728055040/t0(0) o3->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:542/0 lens 488/4536 e 0 to 0 dl 1787784672 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784661.329221:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c3782d00 with x1874627728055040 ext(0->4095) 00002000:00010000:0.0:1787784661.329224:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c3782d00 00010000:00010000:3.0:1787784661.509991:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784662.314222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784662.314332:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784662.314366:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784662.314454:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728055552 00000100:00100000:3.0:1787784662.314464:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728055552 00000100:00100000:3.0:1787784662.314535:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 89 00000100:00100000:3.0:1787784662.314544:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2408:x1874627728055552:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784662.314627:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2408:x1874627728055552:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 84us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784662.314635:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 89 00000100:00100000:0.0:1787784662.318862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784662.318897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784662.319174:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728055168 00000100:00100000:3.0:1787784662.319187:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728055168 00000100:00100000:3.0:1787784662.319237:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 418 00000100:00100000:3.0:1787784662.319247:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951faa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728055168:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784662.319312:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951faa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728055168:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 67us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784662.319336:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 418 00000100:00100000:1.0:1787784662.323052:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728055296 00000100:00100000:1.0:1787784662.323072:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728055296 00000100:00100000:1.0:1787784662.323149:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728055808 00000100:00100000:1.0:1787784662.323153:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728055808 00000100:00080000:1.0:1787784662.323179:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784662.323210:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 320 00000100:00100000:1.0:1787784662.323220:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+27:2408:x1874627728055296:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784662.323291:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+27:2408:x1874627728055296:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 74us (9080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784662.323298:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 320 00000100:00100000:1.0:1787784662.323313:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 321 00000100:00100000:1.0:1787784662.323318:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728055808:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784662.323337:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728055808:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 19us (8971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784662.323436:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 321 00000100:00100000:0.0:1787784662.329559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784662.329593:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784662.329629:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728055424 00000100:00100000:0.0:1787784662.329636:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728055424 00000100:00100000:1.0:1787784662.329648:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728055680 00000100:00100000:1.0:1787784662.329651:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728055680 00000100:00100000:0.0:1787784662.329685:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728055936 00000100:00100000:0.0:1787784662.329688:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728055936 00000100:00100000:1.0:1787784662.329690:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 90 00000100:00100000:1.0:1787784662.329698:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2408:x1874627728055680:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784662.329707:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 322 00000100:00100000:0.0:1787784662.329712:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff470f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728055424:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784662.329802:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff470f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728055424:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 89us (10903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784662.329810:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 322 00000100:00100000:0.0:1787784662.329829:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 323 00000100:00100000:0.0:1787784662.329836:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728055936:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784662.331331:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2408:x1874627728055680:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 1625us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784662.331344:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 90 00000100:00080000:1.0:1787784662.331405:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784662.331629:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784662.334499:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728055936:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 4651us (4893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784662.334525:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 323 00000040:00080000:0.0:1787784662.347421:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787784662.533995:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784663.175477:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750145408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784663.175544:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.175616:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784663.175623:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c7e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750145536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784663.175651:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.175690:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750145536 00000100:00100000:0.0:1787784663.175697:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750145536 00000100:00100000:0.0:1787784663.175742:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787784663.175750:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1219a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750145536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784663.175807:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787784663.175850:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1219a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750145536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784663.175857:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787784663.175903:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c7e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750145536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784663.176243:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750145408 00000100:00100000:2.0:1787784663.176249:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750145408 00000100:00100000:2.0:1787784663.176285:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787784663.176295:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874627750145408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784663.176317:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787784663.176367:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874627750145408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784663.176374:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1787784663.177308:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784663.177373:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750145408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784663.177580:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784663.177592:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3780780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750145664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784663.177637:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784663.177677:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750145664 00000100:00100000:3.0:1787784663.177682:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750145664 00000100:00100000:3.0:1787784663.177727:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787784663.177735:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750145664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784663.177752:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787784663.177808:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750145664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784663.177815:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1787784663.177832:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784663.177851:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3780780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750145664:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787784663.558104:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784663.686040:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784663.686067:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1218780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750145792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784663.686165:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.686291:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750145792 00000100:00100000:0.0:1787784663.686300:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750145792 00000100:00100000:0.0:1787784663.686368:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787784663.686378:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874627750145792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784663.686408:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784663.686472:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874627750145792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784663.686487:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787784663.686538:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1218780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750145792:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787784663.686607:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784663.687220:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3796580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750146048:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.687256:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.687286:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750146560:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.687310:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.687336:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1218780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750147072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784663.687360:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.687382:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787784663.687388:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c37943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750145920:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.687414:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.687435:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3794f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750146432:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.687469:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.687487:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750146944:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.687511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.687541:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750146048 00000100:00100000:0.0:1787784663.687546:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750146048 00000100:00100000:0.0:1787784663.687576:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750146560 00000100:00100000:0.0:1787784663.687579:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750146560 00000100:00100000:0.0:1787784663.687602:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750146432 00000100:00100000:0.0:1787784663.687606:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750146432 00000100:00100000:0.0:1787784663.687624:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787784663.687632:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750146048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.687674:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750146048:12345-0@lo:400:kworker.0 Request processed in 43us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784663.687692:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787784663.687710:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787784663.687717:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750146560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.687748:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750146560:12345-0@lo:400:kworker.0 Request processed in 32us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784663.687754:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787784663.687789:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787784663.687796:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750146432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.687824:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750146432:12345-0@lo:400:kworker.0 Request processed in 29us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784663.687830:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787784663.687849:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750145920 00000100:00100000:0.0:1787784663.687853:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750145920 00000100:00100000:0.0:1787784663.687876:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1787784663.687883:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750145920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.687915:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750145920:12345-0@lo:400:kworker.0 Request processed in 33us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784663.687921:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1787784663.687951:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750146944 00000100:00100000:0.0:1787784663.687955:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750146944 00000100:00100000:0.0:1787784663.687980:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787784663.687987:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750146944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688017:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750146944:12345-0@lo:400:kworker.0 Request processed in 31us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784663.688023:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1787784663.688049:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784663.688054:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784663.688056:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784663.688066:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c37970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750146176:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688095:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.688116:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750146688:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.688172:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787784663.688177:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c37961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750146304:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.688215:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750146816:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688235:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.688261:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750146176 00000100:00100000:0.0:1787784663.688265:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750146176 00000100:00100000:0.0:1787784663.688289:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787784663.688295:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2667c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750146176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688332:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2667c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750146176:12345-0@lo:400:kworker.0 Request processed in 37us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784663.688339:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787784663.688356:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750146688 00000100:00100000:0.0:1787784663.688359:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750146688 00000100:00100000:0.0:1787784663.688381:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750146304 00000100:00100000:0.0:1787784663.688384:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750146304 00000100:00100000:0.0:1787784663.688394:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750146816 00000100:00100000:0.0:1787784663.688396:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750146816 00000100:00100000:0.0:1787784663.688411:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787784663.688417:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750146688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688446:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750146688:12345-0@lo:400:kworker.0 Request processed in 29us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784663.688471:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787784663.688485:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787784663.688490:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750146304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688531:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750146304:12345-0@lo:400:kworker.0 Request processed in 40us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784663.688537:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787784663.688550:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787784663.688556:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750146816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688584:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750146816:12345-0@lo:400:kworker.0 Request processed in 28us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784663.688589:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00080000:0.0:1787784663.688605:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787784663.688608:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784663.688630:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c37943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750145920:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688643:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3794f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750146432:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688652:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750146944:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688662:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3796580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750146048:0@lo:400:kworker.0 00010000:00080000:0.0:1787784663.688675:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3797840 x1874627750146560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784663.688686:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750146560:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688720:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c37961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750146304:0@lo:400:kworker.0 00010000:00080000:0.0:1787784663.688730:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3796940 x1874627750146816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784663.688747:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750146816:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688759:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c37970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750146176:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.688792:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750146688:0@lo:400:kworker.0 00000100:00100000:3.0:1787784663.689129:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750147072 00000100:00100000:3.0:1787784663.689135:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750147072 00000100:00100000:3.0:1787784663.689174:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787784663.689183:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f55c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750147072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787784663.689198:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784663.689248:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f55c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750147072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (1887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784663.689255:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787784663.689555:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1218780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750147072:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1787784663.692756:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1787784663.692801:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:1.0:1787784664.586230:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784665.225962:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c37970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750147200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784665.226038:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784665.227666:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750147200 00000100:00100000:1.0:1787784665.227678:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750147200 00000100:00100000:1.0:1787784665.227746:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787784665.227756:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750147200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787784665.227812:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787784665.227880:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750147200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784665.227888:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787784665.227934:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c37970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750147200:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784665.610074:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787784665.740414:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1787784665.740461:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8951fa95d180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787784665.740468:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8951fbe58600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8951fa95d240 00000020:00080000:0.0:1787784665.740471:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8951fbe58200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8951c137d800 00000020:00080000:0.0:1787784665.740499:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:2.0:1787784665.740557:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d6e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784665.740570:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d6e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784665.740598:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d6e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784665.740604:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784665.740609:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d6e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784665.740618:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d6e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784665.740635:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8951f5138600) 00010000:00010000:2.0:1787784665.740638:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784665.740643:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d6e0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784665.740649:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d6e0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787784665.740719:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787784665.740835:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1787784665.746549:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1787784665.746562:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:1.0:1787784666.633709:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784667.424318:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784667.424435:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784667.424480:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784667.424510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784667.424538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784667.424560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784667.424611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784667.424651:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728056320 00000100:00100000:0.0:1787784667.424662:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728056320 00000100:00100000:0.0:1787784667.424737:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728056832 00000100:00100000:0.0:1787784667.424740:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728056832 00000100:00100000:0.0:1787784667.424810:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728056192 00000100:00100000:0.0:1787784667.424826:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728056192 00000100:00100000:0.0:1787784667.424846:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728056704 00000100:00100000:0.0:1787784667.424849:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728056704 00000100:00100000:0.0:1787784667.424868:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 330 00000100:00100000:0.0:1787784667.424878:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728056320:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784667.424975:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728056320:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 98us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784667.424983:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 330 00000100:00100000:0.0:1787784667.425005:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 331 00000100:00100000:0.0:1787784667.425011:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728056832:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784667.425038:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728056832:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784667.425046:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 331 00000100:00100000:0.0:1787784667.425059:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 332 00000100:00100000:0.0:1787784667.425065:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+13:2405:x1874627728056192:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784667.425089:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+13:2405:x1874627728056192:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784667.425094:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 332 00000100:00100000:0.0:1787784667.425105:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 333 00000100:00100000:0.0:1787784667.425111:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728056704:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784667.425133:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2405:x1874627728056704:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784667.425138:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 333 00000100:00080000:0.0:1787784667.425160:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784667.425171:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784667.425214:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728056576 00000100:00100000:0.0:1787784667.425218:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728056576 00000100:00100000:0.0:1787784667.425250:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728056448 00000100:00100000:0.0:1787784667.425254:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728056448 00000100:00100000:0.0:1787784667.425280:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:0.0:1787784667.425288:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728056576:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784667.425314:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2405:x1874627728056576:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784667.425321:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:0.0:1787784667.425330:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 93 00000100:00100000:0.0:1787784667.425336:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728056448:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784667.425357:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728056448:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784667.425362:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 93 00000100:00080000:0.0:1787784667.425377:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787784667.425380:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784667.426729:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728056064 00000100:00100000:1.0:1787784667.427046:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728056064 00000100:00100000:0.0:1787784667.427518:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 420 00000100:00100000:0.0:1787784667.427532:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2405:x1874627728056064:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784667.427631:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2405:x1874627728056064:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 101us (3328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784667.427640:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 420 00010000:00010000:0.0:1787784667.661569:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784668.192537:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784668.192736:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728056960 00000100:00100000:2.0:1787784668.192747:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728056960 00000100:00100000:2.0:1787784668.192860:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00100000:2.0:1787784668.192872:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+13:11095:x1874627728056960:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787784668.193010:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+13:11095:x1874627728056960:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 139us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784668.193018:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00100000:1.0:1787784668.195492:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784668.195646:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728057088 00000100:00100000:0.0:1787784668.195662:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728057088 00000100:00100000:0.0:1787784668.195754:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 148 00000100:00100000:0.0:1787784668.195815:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c37970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:11095:x1874627728057088:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787784668.195935:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c37970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:11095:x1874627728057088:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 169us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784668.195943:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 148 00000100:00100000:1.0:1787784668.198347:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784668.198456:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728057344 00000100:00100000:3.0:1787784668.198469:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728057344 00000100:00100000:3.0:1787784668.198626:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:3.0:1787784668.198641:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+13:11095:x1874627728057344:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787784668.199030:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+14:11095:x1874627728057344:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 393us (696us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787784668.199039:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:1.0:1787784668.294896:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c37961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750147328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784668.294999:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784668.295139:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750147328 00000100:00100000:0.0:1787784668.295154:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750147328 00000100:00100000:0.0:1787784668.295223:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787784668.295233:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3797840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750147328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784668.295273:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787784668.295821:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3797840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750147328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 587us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784668.295830:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787784668.295889:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c37961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750147328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784668.296718:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750147456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784668.296809:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784668.296863:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784668.296886:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c780b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750147584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784668.296912:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784668.298103:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750147456 00000100:00100000:3.0:1787784668.298122:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750147456 00000100:00080000:1.0:1787784668.298255:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784668.298444:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750147584 00000100:00100000:3.0:1787784668.298449:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750147584 00000100:00080000:1.0:1787784668.298515:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784668.303659:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787784668.303689:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c780ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750147456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784668.303733:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787784668.303847:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c780ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750147456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (7037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784668.303855:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787784668.303882:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787784668.303888:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750147584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784668.303899:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787784668.303926:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750147584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (7012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784668.303950:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787784668.312587:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c780b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750147584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787784668.312613:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1787784668.312619:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8951ff47f0c0, transno 4294967311 00000004:00080000:1.0:1787784668.312648:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1787784668.312726:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750147456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784668.530933:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784668.531245:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728057472 00000100:00100000:0.0:1787784668.531261:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728057472 00000100:00100000:0.0:1787784668.531355:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 149 00000100:00100000:0.0:1787784668.531368:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:11900:x1874627728057472:12345-192.168.202.41@tcp:101:lsof.0 00010000:00010000:0.0:1787784668.531398:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784668.531437:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d76c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ba4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784668.531536:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d773 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784668.531552:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784668.531568:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784668.531632:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787784668.531637:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784668.531691:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784668.531727:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9d76c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ba4 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784668.531754:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ba4 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784668.534081:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128300) 00010000:00010000:0.0:1787784668.534087:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784668.534091:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628400, rc 0) 00000100:00100000:0.0:1787784668.534227:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:11900:x1874627728057472:12345-192.168.202.41@tcp:101:lsof.0 Request processed in 2854us (3303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784668.534237:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 149 00010000:00010000:0.0:1787784668.679799:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784668.806274:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750147840:0@lo:400:kworker.0 00000100:00100000:1.0:1787784668.806274:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c37943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750148096:0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.806454:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3794f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750147968:0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.806679:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3796580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750147712:0@lo:400:kworker.0 00000100:00100000:3.0:1787784668.816012:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784668.816134:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3794b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750148352:0@lo:400:kworker.0 00000100:00100000:3.0:1787784668.816192:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784668.816225:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750148864:0@lo:400:kworker.0 00000100:00100000:3.0:1787784668.816253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784668.816297:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c42ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750149376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784668.816328:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784668.816562:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750147840 00000100:00100000:3.0:1787784668.816572:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750147840 00000100:00100000:3.0:1787784668.816629:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750148352 00000100:00100000:3.0:1787784668.816631:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750148352 00000100:00100000:3.0:1787784668.816662:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750148864 00000100:00100000:3.0:1787784668.816664:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750148864 00000100:00100000:3.0:1787784668.816682:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787784668.816691:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3781a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750147840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784668.816752:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3781a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750147840:12345-0@lo:400:kworker.0 Request processed in 62us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784668.816873:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787784668.816897:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787784668.816903:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3780780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750148352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784668.816934:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3780780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750148352:12345-0@lo:400:kworker.0 Request processed in 31us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784668.816940:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787784668.816950:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787784668.816956:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c37803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750148864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784668.816982:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c37803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750148864:12345-0@lo:400:kworker.0 Request processed in 27us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784668.816988:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:3.0:1787784668.817013:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784668.817034:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750149376 00000100:00100000:3.0:1787784668.817037:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750149376 00000100:00100000:3.0:1787784668.817072:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787784668.817079:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3782580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750149376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787784668.817110:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784668.817207:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784668.817236:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c37961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750148480:0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.817461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784668.817492:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2662580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750148992:0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.817515:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784668.817533:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c42cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750149504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784668.817558:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784668.817605:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750147968 00000100:00100000:0.0:1787784668.817608:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750147968 00000100:00100000:0.0:1787784668.817644:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787784668.817651:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750147968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.817689:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750147968:12345-0@lo:400:kworker.0 Request processed in 39us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784668.817696:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787784668.817714:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750148480 00000100:00100000:0.0:1787784668.817717:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750148480 00000100:00100000:0.0:1787784668.817755:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750148992 00000100:00100000:0.0:1787784668.817757:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750148992 00000100:00100000:0.0:1787784668.817797:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787784668.817803:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750148480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.817834:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750148480:12345-0@lo:400:kworker.0 Request processed in 31us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784668.817840:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787784668.817852:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787784668.817857:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750148992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.817885:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750148992:12345-0@lo:400:kworker.0 Request processed in 28us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784668.817891:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1787784668.817925:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3782580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750149376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 846us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784668.817930:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3794f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750147968:0@lo:400:kworker.0 00000100:00100000:3.0:1787784668.817933:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787784668.817945:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750149504 00010000:00080000:0.0:1787784668.817945:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c37961c0 x1874627750148480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784668.817948:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750149504 00000100:00100000:0.0:1787784668.817956:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c37961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750148480:0@lo:400:kworker.0 00000100:00100000:3.0:1787784668.817964:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00010000:00080000:0.0:1787784668.817966:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2662580 x1874627750148992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784668.817969:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750149504:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784668.817975:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2662580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750148992:0@lo:400:kworker.0 00002000:00000024:3.0:1787784668.817983:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784668.818025:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750149504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784668.818032:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1787784668.818050:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784668.818055:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784668.818095:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c42ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750149376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784668.818109:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750147840:0@lo:400:kworker.0 00000100:00100000:3.0:1787784668.818121:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3794b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750148352:0@lo:400:kworker.0 00000100:00100000:3.0:1787784668.818132:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750148864:0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.818670:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1787784668.818680:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1787784668.818703:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8951d24e2580, transno 4294967305 00000100:00100000:0.0:1787784668.818728:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c42cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750149504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784668.828655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784668.828755:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750148608:0@lo:400:kworker.0 00000100:00100000:1.0:1787784668.828831:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784668.828862:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2663c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750149120:0@lo:400:kworker.0 00000100:00100000:1.0:1787784668.828887:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784668.828946:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750148608 00000100:00100000:1.0:1787784668.828957:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750148608 00000100:00100000:1.0:1787784668.829014:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750149120 00000100:00100000:1.0:1787784668.829018:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750149120 00000100:00100000:1.0:1787784668.829047:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787784668.829059:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750148608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.829179:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750148096 00000100:00100000:0.0:1787784668.829215:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750148096 00000100:00100000:0.0:1787784668.829261:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787784668.829270:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750148096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.829559:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750148096:12345-0@lo:400:kworker.0 Request processed in 290us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784668.829567:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787784668.829627:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787784668.829638:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750149120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.829677:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750149120:12345-0@lo:400:kworker.0 Request processed in 44us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784668.829683:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787784668.829734:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c37943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750148096:0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.829748:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2663c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750149120:0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.829955:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784668.830005:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3794780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750148224:0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.830038:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784668.830141:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750148224 00000100:00100000:2.0:1787784668.830146:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750148224 00000100:00100000:2.0:1787784668.830187:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787784668.830444:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c780b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750148224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.830490:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c780b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750148224:12345-0@lo:400:kworker.0 Request processed in 50us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784668.830497:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787784668.830535:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3794780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750148224:0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.830543:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750148736:0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.830570:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784668.830593:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750148736 00000100:00100000:2.0:1787784668.830597:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750148736 00000100:00100000:2.0:1787784668.830624:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787784668.830631:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750148736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.830663:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750148736:12345-0@lo:400:kworker.0 Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784668.830669:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787784668.830698:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750148736:0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.830725:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750149248:0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.830751:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784668.830798:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750149248 00000100:00100000:2.0:1787784668.830801:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750149248 00000100:00100000:2.0:1787784668.830824:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787784668.830831:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c780a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750149248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.830861:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c780a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750149248:12345-0@lo:400:kworker.0 Request processed in 31us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784668.830868:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787784668.830894:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750149248:0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.831090:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750147712 00000100:00100000:0.0:1787784668.831094:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750147712 00000100:00100000:0.0:1787784668.831134:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1787784668.831142:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750147712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.831201:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750147712:12345-0@lo:400:kworker.0 Request processed in 61us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784668.831208:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1787784668.831550:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3796580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750147712:0@lo:400:kworker.0 00000100:00100000:1.0:1787784668.831691:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750148608:12345-0@lo:400:kworker.0 Request processed in 2634us (2859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784668.831699:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787784668.831837:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750148608:0@lo:400:kworker.0 00010000:00010000:1.0:1787784669.702476:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784670.342054:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784670.343522:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750149632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787784670.343631:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784670.347069:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750149632 00000100:00100000:2.0:1787784670.347093:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750149632 00000100:00100000:2.0:1787784670.347206:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787784670.347220:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c37830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750149632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787784670.347272:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787784670.347581:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c37830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750149632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 363us (3949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784670.347591:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787784670.347707:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750149632:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784670.730151:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787784670.982071:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787784670.982085:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787784670.982274:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:1.0:1787784670.982286:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787784670.993836:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1787784670.993855:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787784670.993925:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787784670.993950:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787784671.754155:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784672.543417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784672.543466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784672.543494:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784672.543511:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784672.543550:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784672.543566:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784672.543587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784672.543619:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728057856 00000100:00100000:1.0:1787784672.543630:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728057856 00000100:00100000:1.0:1787784672.543700:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728058368 00000100:00100000:1.0:1787784672.543702:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728058368 00000100:00100000:1.0:1787784672.543715:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728057728 00000100:00100000:1.0:1787784672.543717:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728057728 00000100:00100000:1.0:1787784672.543728:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728058240 00000100:00100000:1.0:1787784672.543729:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728058240 00000100:00100000:1.0:1787784672.543744:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 340 00000100:00100000:1.0:1787784672.543755:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5628780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627728057856:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784672.543860:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5628780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627728057856:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 107us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784672.543867:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 340 00000100:00100000:1.0:1787784672.543884:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 341 00000100:00100000:1.0:1787784672.543890:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2406:x1874627728058368:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784672.543910:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2406:x1874627728058368:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 21us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784672.543916:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 341 00000100:00100000:1.0:1787784672.543924:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 342 00000100:00100000:1.0:1787784672.543929:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+13:2406:x1874627728057728:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784672.543951:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+13:2406:x1874627728057728:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784672.543957:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 342 00000100:00100000:1.0:1787784672.543973:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 343 00000100:00100000:1.0:1787784672.543978:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2406:x1874627728058240:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784672.543997:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2406:x1874627728058240:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 19us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784672.544002:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 343 00000100:00080000:1.0:1787784672.544026:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784672.544031:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784672.544355:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728058112 00000100:00100000:2.0:1787784672.544359:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728058112 00000100:00100000:2.0:1787784672.544412:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728057984 00000100:00100000:2.0:1787784672.544415:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728057984 00000100:00100000:2.0:1787784672.544435:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 98 00000100:00100000:2.0:1787784672.544446:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627728058112:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784672.544477:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627728058112:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 36us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784672.544490:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 98 00000100:00100000:2.0:1787784672.544502:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00100000:2.0:1787784672.544507:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627728057984:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784672.544527:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627728057984:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 20us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784672.544532:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00080000:1.0:1787784672.545174:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787784672.545182:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784672.546696:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728057600 00000100:00100000:1.0:1787784672.546714:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728057600 00000100:00100000:1.0:1787784672.546820:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 422 00000100:00100000:1.0:1787784672.546831:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2406:x1874627728057600:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784672.546926:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2406:x1874627728057600:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 97us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784672.546934:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 422 00000040:00080000:3.0:1787784672.582668:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784672.775464:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787784672.950424:0:14523:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:51:10 (1787784670) 00000100:00100000:2.0:1787784673.415314:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750149888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784673.415454:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784673.415805:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750149888 00000100:00100000:1.0:1787784673.415817:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750149888 00000100:00100000:1.0:1787784673.415905:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787784673.415917:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1218780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750149888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784673.415967:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787784673.416047:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1218780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750149888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784673.416056:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787784673.416116:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750149888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784673.416672:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c37821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750150016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784673.416726:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784673.417030:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750150016 00000100:00100000:1.0:1787784673.417038:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750150016 00000100:00100000:1.0:1787784673.417091:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787784673.417102:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750150016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784673.417133:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00080000:3.0:1787784673.417198:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784673.417484:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750150016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 384us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784673.417492:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787784673.417560:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c37821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750150016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784673.424966:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750149760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784673.425108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784673.425376:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750149760 00000100:00100000:3.0:1787784673.425388:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750149760 00000100:00100000:3.0:1787784673.425477:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787784673.425491:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750149760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784673.425528:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787784673.425600:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750149760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784673.425609:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1787784673.425750:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784673.426083:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750149760:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787784673.799474:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784673.926039:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750150144:0@lo:400:kworker.0 00000100:00100000:1.0:1787784673.926145:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750150400:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.926148:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784673.926195:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784673.926216:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750150912:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.926223:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750150656:0@lo:400:kworker.0 00000100:00100000:1.0:1787784673.926243:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784673.926244:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784673.926259:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750151168:0@lo:400:kworker.0 00000100:00100000:1.0:1787784673.926259:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750151424:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.926282:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784673.926282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784673.926296:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750151680:0@lo:400:kworker.0 00000100:00100000:1.0:1787784673.926299:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787784673.926316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784673.926316:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750150272:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.926332:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787784673.926337:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750150528:0@lo:400:kworker.0 00000100:00100000:1.0:1787784673.926337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784673.926351:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750150784:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.926360:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784673.926445:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750151168 00000100:00100000:2.0:1787784673.926454:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750151168 00000100:00100000:2.0:1787784673.926512:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750151680 00000100:00100000:2.0:1787784673.926515:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750151680 00000100:00100000:2.0:1787784673.926548:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787784673.926560:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750151168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784673.935541:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750150912 00000100:00100000:1.0:1787784673.935563:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750150912 00000100:00100000:1.0:1787784673.935682:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750151424 00000100:00100000:1.0:1787784673.935687:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750151424 00000100:00100000:1.0:1787784673.935709:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750150272 00000100:00100000:1.0:1787784673.935712:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750150272 00000100:00100000:1.0:1787784673.935723:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750150528 00000100:00100000:1.0:1787784673.935726:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750150528 00000100:00100000:1.0:1787784673.935771:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1787784673.935800:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7e97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750150912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784673.938846:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787784673.938887:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1787784673.938909:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750150272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784673.941447:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750151168:12345-0@lo:400:kworker.0 Request processed in 14875us (15150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784673.941468:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787784673.941519:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787784673.941539:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3780b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750151680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784673.941638:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3780b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750151680:12345-0@lo:400:kworker.0 Request processed in 110us (15320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784673.941645:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787784673.941697:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750150400 00000100:00100000:2.0:1787784673.941707:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750150400 00000100:00100000:2.0:1787784673.941755:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750150656 00000100:00100000:2.0:1787784673.941759:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750150656 00000100:00100000:2.0:1787784673.941794:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787784673.941801:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750150400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784673.945223:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750150400:12345-0@lo:400:kworker.0 Request processed in 39us (15644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784673.945256:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787784673.945313:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787784673.945339:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c37821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750150656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784673.945474:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c37821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750150656:12345-0@lo:400:kworker.0 Request processed in 151us (19228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784673.945480:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787784673.945560:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750150144 00000100:00100000:2.0:1787784673.945570:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750150144 00000100:00100000:2.0:1787784673.947299:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1787784673.947328:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750150144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784673.947452:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750150144:12345-0@lo:400:kworker.0 Request processed in 140us (21304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784673.947460:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1787784673.947538:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784673.947584:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750151296:0@lo:400:kworker.0 00000100:00100000:2.0:1787784673.950041:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784673.950113:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750150400:0@lo:400:kworker.0 00000100:00100000:2.0:1787784673.950173:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2663c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750151936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784673.950204:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784673.950252:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784673.950260:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c42ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750151808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784673.950285:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784673.950378:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750151936 00000100:00100000:2.0:1787784673.950387:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750151936 00000100:00100000:2.0:1787784673.950447:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750151808 00000100:00100000:2.0:1787784673.950450:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750151808 00000100:00100000:2.0:1787784673.950477:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787784673.950487:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750151936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784673.950528:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784673.950578:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750151936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784673.950587:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787784673.951425:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787784673.951441:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750151808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787784673.951460:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784673.951509:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750151808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784673.951516:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787784673.951570:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c42ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750151808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784673.951587:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2663c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750151936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784673.958466:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1787784673.958492:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:2.0:1787784673.958527:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1787784673.958540:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750150784 00000100:00100000:2.0:1787784673.958553:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750150784 00000100:00100000:3.0:1787784673.961018:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750151040:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.961113:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784673.961158:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750151040 00000100:00100000:3.0:1787784673.961167:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750151040 00000100:00100000:3.0:1787784673.961226:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787784673.961235:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750151040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.961294:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750151040:12345-0@lo:400:kworker.0 Request processed in 60us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784673.961300:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787784673.961350:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750151040:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.961358:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750151552:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.961394:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784673.961416:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750151552 00000100:00100000:3.0:1787784673.961420:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750151552 00000100:00100000:3.0:1787784673.961465:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787784673.961471:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750151552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.961502:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750151552:12345-0@lo:400:kworker.0 Request processed in 32us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784673.961508:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787784673.961535:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750151552:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.961550:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750150656:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.961564:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750151168:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.961578:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750151680:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.961590:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750150144:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.961689:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750151296 00000100:00100000:3.0:1787784673.961694:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750151296 00000100:00100000:3.0:1787784673.961724:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:3.0:1787784673.961733:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787784673.961740:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750150528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.961805:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750150528:12345-0@lo:400:kworker.0 Request processed in 65us (35444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784673.961811:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787784673.961823:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:3.0:1787784673.961829:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787784673.961835:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750151296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.961873:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750151296:12345-0@lo:400:kworker.0 Request processed in 38us (11837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784673.961879:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787784673.961921:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750151296:0@lo:400:kworker.0 00000100:00100000:3.0:1787784673.961958:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750150528:0@lo:400:kworker.0 00000100:00080000:3.0:1787784673.962266:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784673.962272:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784673.962277:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784673.963869:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787784673.963900:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750150784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784673.964012:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750150784:12345-0@lo:400:kworker.0 Request processed in 131us (16474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784673.964020:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787784673.964080:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750150784:0@lo:400:kworker.0 00000100:00100000:1.0:1787784673.964333:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7e97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750150912:12345-0@lo:400:kworker.0 Request processed in 28550us (38086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784673.964342:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1787784673.964390:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750151424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784673.964426:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750151424:12345-0@lo:400:kworker.0 Request processed in 25566us (38145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784673.964433:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787784673.965973:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750150272:12345-0@lo:400:kworker.0 Request processed in 27067us (39623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784673.965988:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787784673.966475:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750150272:0@lo:400:kworker.0 00010000:00080000:2.0:1787784673.966502:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff47b0c0 x1874627750150912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784673.966514:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750150912:0@lo:400:kworker.0 00010000:00080000:2.0:1787784673.966528:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d24b2d00 x1874627750151424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784673.966536:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750151424:0@lo:400:kworker.0 00000100:00100000:1.0:1787784674.528283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784674.528382:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728058624 00000100:00100000:3.0:1787784674.528394:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728058624 00000100:00100000:3.0:1787784674.528564:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 150 00000100:00100000:3.0:1787784674.528580:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+13:12167:x1874627728058624:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784674.528611:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784674.528639:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9d77a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72bab expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.528736:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d781 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.528754:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d781 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.528811:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d781 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.528830:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d788 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.528837:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d788 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.528844:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d788 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529164:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d78f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529175:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d78f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529181:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d78f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784674.529193:0:14535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787784674.529386:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d781 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529395:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d781 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529402:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d781 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529409:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784674.529415:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d781 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529424:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d781 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787784674.529540:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787784674.529582:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8951f5128200) 00010000:00010000:3.0:1787784674.529586:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784674.529591:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d781 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529610:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d781 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529628:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d788 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529634:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d788 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529640:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d788 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529644:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784674.529647:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d788 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529654:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d788 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529661:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8951f5138800) 00010000:00010000:3.0:1787784674.529663:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784674.529665:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d788 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.529671:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d788 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.530600:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9d77a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bab expref: 16 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.530625:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d78f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bab expref: 15 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784674.530643:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951f5128c00) 00010000:00010000:3.0:1787784674.530646:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784674.530649:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712600, rc 0) 00000100:00100000:3.0:1787784674.530751:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+15:12167:x1874627728058624:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 2174us (2483us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787784674.530762:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 150 00000100:00100000:3.0:1787784674.536400:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784674.536535:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728058752 00000100:00100000:1.0:1787784674.536549:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728058752 00000100:00100000:1.0:1787784674.536639:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 151 00000100:00100000:1.0:1787784674.536650:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+15:12167:x1874627728058752:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787784674.536849:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+15:12167:x1874627728058752:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 199us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784674.536858:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 151 00000100:00100000:2.0:1787784674.540494:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784674.540638:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728058880 00000100:00100000:3.0:1787784674.540652:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728058880 00000100:00100000:3.0:1787784674.540750:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00100000:3.0:1787784674.540764:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:12167:x1874627728058880:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787784674.540963:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:12167:x1874627728058880:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 202us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784674.540973:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00080000:1.0:1787784674.541224:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784674.541982:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784674.542171:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728059008 00000100:00100000:2.0:1787784674.542180:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728059008 00000100:00100000:2.0:1787784674.542254:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:2.0:1787784674.542266:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+15:2407:x1874627728059008:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784674.542284:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784674.542337:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9d78f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bab expref: 15 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784674.542371:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951f5128c00) 00010000:00010000:2.0:1787784674.542378:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784674.543148:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+14:2407:x1874627728059008:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 879us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784674.543162:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000040:00080000:3.0:1787784674.632833:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787784674.826727:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787784675.079063:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787784675.079078:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787784675.079103:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:1.0:1787784675.079113:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787784675.462692:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750152064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784675.462910:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784675.463027:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750152064 00000100:00100000:0.0:1787784675.463037:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750152064 00000100:00100000:0.0:1787784675.463105:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787784675.463116:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750152064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784675.463161:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787784675.467104:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750152064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3974us (4179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784675.467124:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787784675.467285:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750152064:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784675.850966:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784676.870977:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784676.961456:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784676.961950:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728059136 00000100:00100000:3.0:1787784676.961966:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728059136 00000100:00080000:1.0:1787784676.962186:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784676.962237:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 153 00000100:00100000:3.0:1787784676.962249:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+14:12208:x1874627728059136:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1787784676.962274:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784676.962300:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9d79d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72bb2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962394:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d7a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962426:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d7a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962438:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d7a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962455:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d7ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962462:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d7ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962469:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d7ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962516:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d7a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962523:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d7a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962529:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d7a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962535:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784676.962540:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d7a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962547:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d7a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962559:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128300) 00010000:00010000:3.0:1787784676.962571:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784676.962576:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d7a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962582:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d7a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962608:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d7ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962614:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d7ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962620:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d7ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962626:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784676.962629:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d7ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962634:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d7ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962641:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8951f5138800) 00010000:00010000:3.0:1787784676.962644:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784676.962646:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d7ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962651:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9d7ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962687:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9d79d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bb2 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962710:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128300) 00010000:00010000:3.0:1787784676.962712:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784676.962716:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9d79d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bb2 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.962725:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712000, rc 0) 00000100:00100000:3.0:1787784676.962822:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+14:12208:x1874627728059136:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 576us (1377us total) trans 0 rc 301/301 00000100:00100000:3.0:1787784676.962830:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 153 00000100:00100000:3.0:1787784676.980280:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784676.982112:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728059392 00000100:00100000:1.0:1787784676.982126:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728059392 00000100:00100000:1.0:1787784676.986483:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 154 00000100:00100000:1.0:1787784676.986523:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+14:12208:x1874627728059392:12345-192.168.202.41@tcp:36:lfs.0 00010000:00010000:1.0:1787784676.986586:0:11332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784676.986614:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d0f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729d6 expref: 14 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784676.986636:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128300) 00010000:00010000:1.0:1787784676.986641:0:11332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784676.986706:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784676.986719:0:11332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d773 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ba4 expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784676.986729:0:11332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784676.986764:0:11332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ba4 expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784676.986805:0:11332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d773 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ba4 expref: 5 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784676.986819:0:11332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36a70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750152192:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784676.986933:0:11332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784676.993422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784676.993501:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728059520 00000100:00100000:3.0:1787784676.993510:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728059520 00010000:00010000:3.0:1787784676.993573:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d773 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ba4 expref: 6 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784676.993615:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:3.0:1787784676.993624:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2405:x1874627728059520:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784676.993640:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784676.993647:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d773 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ba4 expref: 6 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.993660:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d773 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ba4 expref: 6 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.993682:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128300) 00010000:00010000:3.0:1787784676.993700:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.993710:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.993719:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784676.993738:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784676.993818:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2405:x1874627728059520:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 194us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784676.993826:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00080000:1.0:1787784676.994035:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787784676.994299:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d773 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ba4 expref: 5 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784676.994318:0:11332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36a70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750152192:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784676.994348:0:11332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.994368:0:11332:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.994373:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.994397:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d7b9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.994420:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.994428:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.995203:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d7c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.995217:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d7c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.995225:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d7c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784676.995242:0:11332:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c06ecaa reply state 00000000db6ddc09 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d7c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.995253:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d7c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.995674:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784676.995677:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784676.995682:0:11332:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787784676.995688:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787784676.995697:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.995703:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.995711:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.995726:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784676.995730:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.995737:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.995748:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128300) 00010000:00010000:2.0:1787784676.995750:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784676.995754:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.995760:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d7b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784676.995800:0:11332:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c06ecaa reply state 00000000db6ddc09 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.995808:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d7b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784676.995814:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8951e0a67100) 00010000:00010000:2.0:1787784676.995816:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784676.995818:0:11332:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787784676.995966:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+15:12208:x1874627728059392:12345-192.168.202.41@tcp:36:lfs.0 Request processed in 9451us (15694us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1787784676.995976:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 154 00000100:00100000:1.0:1787784677.088721:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784677.089111:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728059648 00000100:00100000:3.0:1787784677.089130:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728059648 00000100:00100000:3.0:1787784677.089238:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 155 00000100:00100000:3.0:1787784677.089251:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+15:12217:x1874627728059648:12345-192.168.202.41@tcp:101:lctl.0 00010000:00010000:3.0:1787784677.089280:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784677.089304:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9d7c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72bb9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.089395:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d7ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.089410:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d7ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.089422:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d7ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784677.089471:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787784677.089491:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787784677.090232:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d7ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.090271:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9d7c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bb9 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.090298:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d7ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bb9 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.090309:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5138800) 00010000:00010000:3.0:1787784677.090312:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784677.090316:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713e00, rc 0) 00000100:00100000:3.0:1787784677.090438:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+16:12217:x1874627728059648:12345-192.168.202.41@tcp:101:lctl.0 Request processed in 1188us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784677.090446:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 155 00000100:00100000:3.0:1787784677.175521:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784677.176485:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728059776 00000100:00100000:2.0:1787784677.176505:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728059776 00000100:00100000:2.0:1787784677.176618:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 156 00000100:00100000:2.0:1787784677.176652:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+16:12223:x1874627728059776:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784677.176685:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784677.176715:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d7d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72bc0 expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.176851:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d7dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.176870:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d7dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.176883:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d7dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.176897:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d7e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.176904:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.176910:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177015:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d7ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177024:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d7ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177031:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d7ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784677.177089:0:14535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787784677.177094:0:14535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787784677.177124:0:14535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d7ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177140:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d7dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177147:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d7dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177154:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d7dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177161:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784677.177166:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d7dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177174:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d7dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177191:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5138800) 00010000:00010000:2.0:1787784677.177194:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784677.177201:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d7dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177207:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b600/0x88ace7295d9d7dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177222:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177238:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d7e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177243:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177248:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5be00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784677.177251:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177257:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d7e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177265:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8951e0a67100) 00010000:00010000:2.0:1787784677.177268:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784677.177271:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d7e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177277:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5be00/0x88ace7295d9d7e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177389:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5b800/0x88ace7295d9d7d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bc0 expref: 18 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177408:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d7ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bc0 expref: 17 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.177416:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784677.177418:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787784677.177428:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff895201c5a800, rc 0) 00000100:00100000:2.0:1787784677.177594:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+17:12223:x1874627728059776:12345-192.168.202.41@tcp:101:bash.0 Request processed in 944us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784677.177604:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 156 00000100:00100000:0.0:1787784677.184061:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784677.184151:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728060032 00000100:00100000:2.0:1787784677.184160:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728060032 00000100:00100000:2.0:1787784677.184223:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 157 00000100:00100000:2.0:1787784677.184231:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2662580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+17:12223:x1874627728060032:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784677.184248:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784677.184267:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d7f1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72bc7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.184404:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d7f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.184419:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d7f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.184430:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d7f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.184473:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d7ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.184481:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d7ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.184487:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d7ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787784677.187271:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787784677.189221:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9d806 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.190434:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9d806 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.190451:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9d806 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.190509:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d7f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.190518:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d7f8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.190525:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d7f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.190531:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ac00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784677.190536:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d7f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.190544:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d7f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.190556:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784677.190560:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784677.190565:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d7f8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.190572:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ac00/0x88ace7295d9d7f8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784677.190618:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024474697 reply state 000000007e4cd8ab transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d7ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.190639:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d7ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.190646:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67200) 00010000:00010000:2.0:1787784677.190649:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784677.190652:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787784677.190699:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5bc00/0x88ace7295d9d7f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bc7 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.190715:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9d806 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bc7 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.190722:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67c00) 00010000:00010000:2.0:1787784677.190724:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784677.190726:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4182e00, rc 0) 00000100:00100000:2.0:1787784677.190854:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2662580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+20:12223:x1874627728060032:12345-192.168.202.41@tcp:101:bash.0 Request processed in 6622us (6802us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787784677.190863:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 157 00000100:00100000:2.0:1787784677.203087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784677.204472:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728060160 00000100:00100000:3.0:1787784677.204493:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728060160 00000100:00100000:3.0:1787784677.204626:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:3.0:1787784677.204639:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728060160:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1787784677.204667:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784677.204702:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9d814 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72bce expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784677.204741:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784677.204819:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=417s v=(0 0) 00010000:00010000:3.0:1787784677.204825:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784677.204858:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9d814 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bce expref: 6 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.204887:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9d814 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bce expref: 6 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.204905:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712000, rc 0) 00000100:00100000:3.0:1787784677.205004:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2407:x1874627728060160:12345-192.168.202.41@tcp:101:bash.0 Request processed in 368us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784677.205012:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00080000:1.0:1787784677.205248:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784677.211834:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784677.211950:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728060288 00000100:00100000:3.0:1787784677.211959:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728060288 00000100:00100000:3.0:1787784677.212015:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:3.0:1787784677.212027:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbf0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+6:12223:x1874627728060288:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1787784677.212050:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784677.212073:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72bd5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.212102:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9d814 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bce expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.212110:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784677.212114:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784677.212117:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.212149:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9d814 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bce expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.212176:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9d814 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bce expref: 7 pid: 8438 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784677.212187:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4db840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1874627750152320:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787784677.212279:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665840 going to sleep for 11 seconds 00000100:00100000:0.0:1787784677.218092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784677.218120:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4db840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1874627750152320:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784677.218160:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.218183:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713800, rc 0) 00000100:00100000:3.0:1787784677.218317:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbf0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:12223:x1874627728060288:12345-192.168.202.41@tcp:101:bash.0 Request processed in 6290us (6491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784677.218327:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:2.0:1787784677.219541:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728060416 00000100:00100000:2.0:1787784677.219556:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728060416 00010000:00010000:2.0:1787784677.219611:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9d814 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bce expref: 7 pid: 8438 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784677.219672:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 85 00000100:00100000:2.0:1787784677.219701:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2661e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728060416:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784677.219720:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784677.219749:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9d814 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bce expref: 7 pid: 8438 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.219993:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9d814 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bce expref: 7 pid: 8438 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.220028:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9d814 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bce expref: 7 pid: 8438 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.220137:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784677.220142:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784677.220151:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.220163:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.220205:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784677.220219:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1874627750152448:192.168.202.41@tcp:105: 00000100:00100000:2.0:1787784677.220297:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c36859c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784677.223918:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784677.224085:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728060672 00000100:00100000:1.0:1787784677.224094:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728060672 00000100:00100000:1.0:1787784677.224182:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:1.0:1787784677.224191:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2663c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+20:12223:x1874627728060672:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:1.0:1787784677.224959:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2663c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12223:x1874627728060672:12345-192.168.202.41@tcp:35:bash.0 Request processed in 767us (1048us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787784677.224969:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:2.0:1787784677.225171:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1874627750152448:192.168.202.41@tcp:105: 00010000:00010000:2.0:1787784677.225213:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784677.225241:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2661e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2405:x1874627728060416:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 5542us (7160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784677.225249:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 85 00000100:00100000:3.0:1787784677.335446:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784677.335549:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728060928 00000100:00100000:0.0:1787784677.335558:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728060928 00000100:00100000:0.0:1787784677.335620:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 158 00000100:00100000:0.0:1787784677.335641:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12233:x1874627728060928:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784677.335680:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784677.335702:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72bdc expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784677.335843:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787784677.335954:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d822 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bdc expref: 23 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784677.335971:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5138800) 00010000:00010000:0.0:1787784677.335974:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784677.335979:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bdc expref: 23 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784677.336006:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628400, rc 0) 00000100:00100000:0.0:1787784677.336073:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+22:12233:x1874627728060928:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 444us (636us total) trans 4294967422 rc 301/301 00000100:00100000:0.0:1787784677.336080:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 158 00000100:00100000:0.0:1787784677.344986:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784677.345154:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728061184 00000100:00100000:1.0:1787784677.345164:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728061184 00000100:00100000:1.0:1787784677.345237:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:1.0:1787784677.345248:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2662940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+22:12233:x1874627728061184:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1787784677.345525:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2662940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+23:12233:x1874627728061184:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 277us (550us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1787784677.345535:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:1.0:1787784677.488173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784677.488311:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728061312 00000100:00100000:2.0:1787784677.488322:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728061312 00000100:00100000:2.0:1787784677.488411:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 159 00000100:00100000:2.0:1787784677.488423:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+23:12239:x1874627728061312:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784677.488450:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784677.488474:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9d830 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72be3 expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.488544:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9d837 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.488561:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9d837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.488572:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9d837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784677.488615:0:14535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787784677.488619:0:14535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787784677.488641:0:14535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9d837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.488668:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9d830 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72be3 expref: 25 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.488686:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9d837 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72be3 expref: 24 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.488710:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784677.488713:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784677.488718:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4182600, rc 0) 00000100:00100000:2.0:1787784677.488849:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+24:12239:x1874627728061312:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 428us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784677.488857:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 159 00000100:00100000:2.0:1787784677.493929:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784677.497636:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728061568 00000100:00100000:1.0:1787784677.497654:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728061568 00000100:00100000:1.0:1787784677.497734:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 160 00000100:00100000:1.0:1787784677.497745:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+24:12239:x1874627728061568:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787784677.497781:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784677.497806:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d83e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72bea expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784677.497931:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d845 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784677.497946:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784677.497973:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784677.497998:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787784677.498115:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d83e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bea expref: 27 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784677.498135:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bea expref: 26 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784677.498145:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67c00) 00010000:00010000:1.0:1787784677.498148:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784677.498151:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602e00, rc 0) 00000100:00100000:1.0:1787784677.498356:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+26:12239:x1874627728061568:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 611us (4436us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1787784677.498364:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 160 00000100:00100000:0.0:1787784677.513163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784677.513228:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784677.513326:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728061952 00000100:00100000:1.0:1787784677.513364:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728061952 00000100:00100000:1.0:1787784677.513434:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:1.0:1787784677.513445:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3795a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+26:12239:x1874627728061952:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787784677.513470:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784677.513490:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d853 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72bf1 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784677.513596:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d85a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784677.513630:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d85a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784677.513642:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d85a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784677.513656:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787784677.513760:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d853 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bf1 expref: 29 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784677.513836:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d85a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bf1 expref: 28 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784677.513845:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67c00) 00010000:00010000:1.0:1787784677.513848:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787784677.513852:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602000, rc 0) 00000100:00100000:1.0:1787784677.513912:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3795a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+28:12239:x1874627728061952:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 468us (683us total) trans 4294967425 rc 0/0 00000100:00100000:1.0:1787784677.513919:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:3.0:1787784677.514890:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728061696 00000100:00100000:3.0:1787784677.514899:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728061696 00000100:00100000:3.0:1787784677.514959:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:3.0:1787784677.514968:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26612c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+28:2405:x1874627728061696:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784677.515116:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784677.515140:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9d845 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bea expref: 28 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.515156:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67c00) 00010000:00010000:3.0:1787784677.515171:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784677.515225:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26612c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+27:2405:x1874627728061696:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 258us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784677.515233:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:0.0:1787784677.534264:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784677.536866:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728062080 00000100:00100000:2.0:1787784677.536884:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728062080 00000100:00100000:2.0:1787784677.536969:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:2.0:1787784677.536980:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2408:x1874627728062080:12345-192.168.202.41@tcp:1:lfs.0 00010000:00010000:2.0:1787784677.537037:0:8916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.537060:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.537069:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784677.537075:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784677.537080:0:8916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.537119:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.537156:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 6 pid: 8437 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784677.537171:0:8916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8916:1874627750152576:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784677.537479:0:8916:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c36859c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784677.541068:0:8916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8916:1874627750152576:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784677.541107:0:8916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784677.551500:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784677.552158:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728062208 00000100:00100000:2.0:1787784677.552170:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728062208 00002000:00100000:2.0:1787784677.552235:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8950c3796580 x1874627728062208/t0(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:558/0 lens 504/0 e 0 to 0 dl 1787784688 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787784677.552245:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c3796580 with x1874627728062208 ext(0->12) 00010000:00010000:2.0:1787784677.552255:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 7 pid: 8437 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.552272:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 7 pid: 8437 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784677.552280:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8950c3796580 00000100:00100000:2.0:1787784677.552319:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:2.0:1787784677.552341:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3796580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728062208:12345-192.168.202.41@tcp:4:lfs.0 00000100:00100000:2.0:1787784677.554190:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3796580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2405:x1874627728062208:12345-192.168.202.41@tcp:4:lfs.0 Request processed in 1852us (2693us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787784677.554276:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00002000:00100000:2.0:1787784677.554288:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8950c3796580 x1874627728062208/t4294967306(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:558/0 lens 504/448 e 0 to 0 dl 1787784688 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787784677.554298:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c3796580 with x1874627728062208 ext(0->12) 00010000:00010000:2.0:1787784677.554308:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 9 pid: 8437 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.554325:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 9 pid: 8437 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784677.554343:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8950c3796580 00000100:00100000:1.0:1787784677.558161:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784677.558516:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728062336 00000100:00100000:0.0:1787784677.558526:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728062336 00010000:00010000:0.0:1787784677.558569:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 9 pid: 8437 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784677.558618:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 86 00000100:00100000:0.0:1787784677.558645:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2407:x1874627728062336:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784677.558662:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787784677.558681:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787784677.558684:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787784677 00002000:00010000:0.0:1787784677.558686:0:6505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787784677 00002000:00010000:0.0:1787784677.558688:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787784677 00002000:00010000:0.0:1787784677.558690:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787784677.558697:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 9 pid: 8437 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784677.558711:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 9 pid: 8437 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784677.558735:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9d81b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bd5 expref: 9 pid: 8437 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784677.558754:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787784677.558759:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787784677.558765:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784677.558873:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784677.558908:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784677.558966:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2407:x1874627728062336:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 322us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784677.559113:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 86 00010000:00010000:3.0:1787784677.559827:0:8916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.559839:0:8916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.559868:0:8916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.559876:0:8916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.559885:0:8916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.559892:0:8916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784677.559897:0:8916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.559906:0:8916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.559920:0:8916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.559940:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9d868 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784677.560141:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2408:x1874627728062080:12345-192.168.202.41@tcp:1:lfs.0 Request processed in 23160us (25885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784677.560151:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:0.0:1787784677.564699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784677.564808:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728062592 00000100:00100000:2.0:1787784677.564926:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728062592 00000100:00100000:2.0:1787784677.564996:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:2.0:1787784677.565007:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f0040850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+27:12239:x1874627728062592:12345-192.168.202.41@tcp:35:lfs.0 00000004:00010000:2.0:1787784677.565077:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d85a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bf1 expref: 27 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784677.565740:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787784677.566056:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1787784677.566746:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:2.0:1787784677.567161:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.567181:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9d806 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bc7 expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.567469:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.567520:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9d806 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bc7 expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.567536:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9d806 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bc7 expref: 31 pid: 6522 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784677.567552:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874627750152704:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784677.567703:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c36859c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784677.573605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784677.573721:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874627750152704:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784677.573755:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784677.573952:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728062720 00000100:00100000:3.0:1787784677.573960:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728062720 00010000:00010000:3.0:1787784677.574070:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9d806 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bc7 expref: 32 pid: 6522 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784677.574151:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00100000:3.0:1787784677.574162:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3795680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+32:2406:x1874627728062720:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784677.574180:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784677.574187:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9d806 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bc7 expref: 32 pid: 6522 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.574200:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9d806 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bc7 expref: 32 pid: 6522 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.574236:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9d806 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bc7 expref: 32 pid: 6522 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.574253:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67c00) 00010000:00010000:3.0:1787784677.574268:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.574291:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.574299:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.574339:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784677.574415:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3795680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+31:2406:x1874627728062720:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 254us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784677.574423:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 87 00010000:00010000:2.0:1787784677.574481:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.574489:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784677.574608:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:2.0:1787784677.574742:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1787784677.575663:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874627750152832:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787784677.575731:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784677.575804:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685840 going to sleep for 11 seconds 00000100:00100000:1.0:1787784677.575902:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750152832 00000100:00100000:1.0:1787784677.575910:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750152832 00000100:00100000:1.0:1787784677.575982:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787784677.576007:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874627750152832:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787784677.576113:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874627750152832:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 111us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784677.576121:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:1.0:1787784677.576159:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784677.576307:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874627750152832:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787784677.576742:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:2.0:1787784677.577051:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874627750152960:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787784677.577099:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784677.577121:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784677.577667:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750152960 00000100:00100000:1.0:1787784677.577676:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750152960 00000100:00100000:1.0:1787784677.577728:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787784677.577738:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874627750152960:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787784677.577937:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6524:x1874627750152960:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 199us (835us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787784677.577945:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787784677.578184:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874627750152960:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787784677.578311:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1787784677.578483:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.578495:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.578504:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.578510:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784677.578516:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.578525:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.578541:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67c00) 00010000:00010000:2.0:1787784677.578544:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787784677.578548:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.578554:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d86f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787784677.578671:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787784677.578758:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787784677.578794:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 417828025372ns, next at 418828022876ns, rc = 0 00000001:00080000:2.0:1787784677.578802:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:2.0:1787784677.579739:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67c00) 00010000:00010000:2.0:1787784677.579746:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787784677.579755:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9d85a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bf1 expref: 35 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784677.580223:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f0040850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+34:12239:x1874627728062592:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 15216us (15535us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787784677.580232:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00000020:00080000:2.0:1787784677.580238:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787784677.585718:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784677.585966:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728062848 00000100:00100000:2.0:1787784677.585977:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728062848 00000100:00100000:2.0:1787784677.586057:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:2.0:1787784677.586068:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3794780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+34:12239:x1874627728062848:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784677.586096:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784677.586125:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183a00/0x88ace7295d9d876 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72bf8 expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.586182:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183a00/0x88ace7295d9d876 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bf8 expref: 35 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.586196:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183a00/0x88ace7295d9d876 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bf8 expref: 35 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.586287:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784677.586291:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784677.586307:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183a00, rc 0) 00000100:00100000:2.0:1787784677.586567:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3794780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+35:12239:x1874627728062848:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 501us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784677.586575:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:0.0:1787784677.593210:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784677.593615:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728063104 00000100:00100000:3.0:1787784677.593627:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728063104 00000100:00100000:3.0:1787784677.593697:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:3.0:1787784677.593708:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c37943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+35:12239:x1874627728063104:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1787784677.594502:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c37943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+36:12239:x1874627728063104:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 791us (1297us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787784677.594513:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:0.0:1787784677.669477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784677.669528:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784677.669567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784677.669611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784677.669646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784677.669680:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728063744 00000100:00100000:0.0:1787784677.669691:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728063744 00000100:00100000:0.0:1787784677.669755:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728063360 00000100:00100000:0.0:1787784677.669758:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728063360 00000100:00100000:0.0:1787784677.669835:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728063616 00000100:00100000:0.0:1787784677.669839:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728063616 00000100:00100000:0.0:1787784677.669863:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 350 00000100:00100000:0.0:1787784677.669874:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2406:x1874627728063744:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784677.669952:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2406:x1874627728063744:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 80us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784677.669960:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 350 00000100:00100000:0.0:1787784677.669974:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 351 00000100:00100000:1.0:1787784677.670583:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 352 00000100:00100000:1.0:1787784677.670598:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2406:x1874627728063616:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784677.670642:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2406:x1874627728063616:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 49us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784677.670650:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 352 00000100:00080000:1.0:1787784677.670702:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784677.671510:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c37961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627728063360:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784677.671569:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c37961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2406:x1874627728063360:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 1587us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784677.671809:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728063232 00000100:00100000:3.0:1787784677.671925:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728063232 00000100:00100000:3.0:1787784677.671976:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 424 00000100:00100000:3.0:1787784677.671984:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2406:x1874627728063232:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784677.672165:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2406:x1874627728063232:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 180us (2701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784677.672172:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 424 00000100:00100000:2.0:1787784677.672431:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728063488 00000100:00100000:2.0:1787784677.672436:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728063488 00000100:00100000:2.0:1787784677.672487:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 104 00000100:00100000:2.0:1787784677.672494:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3794b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627728063488:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784677.672522:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3794b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627728063488:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 30us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784677.672529:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 104 00000100:00100000:0.0:1787784677.672662:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 351 00000100:00080000:3.0:1787784677.674132:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784677.806641:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784677.811568:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728064000 00000100:00100000:1.0:1787784677.811584:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728064000 00000100:00100000:1.0:1787784677.811676:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:1.0:1787784677.811687:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+36:12249:x1874627728064000:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787784677.811716:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784677.811739:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d87d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72bff expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784677.811908:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787784677.812037:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d87d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bff expref: 38 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784677.812055:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5138800) 00010000:00010000:1.0:1787784677.812075:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787784677.812082:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d87d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bff expref: 38 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784677.812098:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602c00, rc 0) 00000100:00100000:1.0:1787784677.812171:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+37:12249:x1874627728064000:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 486us (5542us total) trans 4294967436 rc 301/301 00000100:00100000:1.0:1787784677.812179:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:1.0:1787784677.816993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784677.817263:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728064128 00000100:00100000:3.0:1787784677.817274:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728064128 00000100:00100000:3.0:1787784677.821385:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:3.0:1787784677.821418:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+37:12249:x1874627728064128:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:3.0:1787784677.821548:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d88b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821567:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d88b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821581:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d88b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821593:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d892 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821599:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821605:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821687:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d899 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821696:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d899 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821703:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d899 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784677.821758:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d899 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821788:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d88b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821804:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d88b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821810:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d88b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821815:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784677.821819:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d88b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821825:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d88b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821836:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:3.0:1787784677.821839:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784677.821845:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d88b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821852:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d88b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821868:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821874:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d892 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821879:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d892 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821884:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784677.821894:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d892 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821901:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d892 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821911:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67200) 00010000:00010000:3.0:1787784677.821913:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784677.821917:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d892 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821922:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d892 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821933:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d899 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821939:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d899 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821945:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d899 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821950:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784677.821952:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d899 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821957:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d899 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821964:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:3.0:1787784677.821966:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784677.821975:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d899 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.821980:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d899 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784677.822060:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+37:12249:x1874627728064128:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 659us (5083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784677.822069:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:0.0:1787784677.828432:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784677.828513:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728064384 00000100:00100000:2.0:1787784677.828525:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728064384 00000100:00100000:2.0:1787784677.828593:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:2.0:1787784677.828604:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff476d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+37:12249:x1874627728064384:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1787784677.829201:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff476d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+38:12249:x1874627728064384:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 597us (776us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787784677.829209:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 40 00010000:00010000:2.0:1787784677.896443:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784677.904462:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784677.905339:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728064640 00000100:00100000:3.0:1787784677.905352:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728064640 00000100:00100000:3.0:1787784677.905435:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:3.0:1787784677.905445:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+38:12252:x1874627728064640:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1787784677.905472:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784677.905496:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d8a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.905599:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d8a7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.905616:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d8a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.905993:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d8a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.906014:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d8ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.906022:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d8ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.906055:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d8ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.906196:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d8b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.906342:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.906351:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784677.906362:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787784677.906454:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d8a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.906462:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d8a7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.906469:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.906476:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784677.906480:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.906488:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d8a7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.907315:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:3.0:1787784677.907324:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784677.907353:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d8a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.907362:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9d8a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.907393:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d8ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.907400:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d8ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.907406:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d8ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.907411:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784677.907414:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d8ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.907420:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d8ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.907431:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67200) 00010000:00010000:3.0:1787784677.907433:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784677.907436:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d8ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.907441:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d8ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.908174:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d8a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c06 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.908226:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c06 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784677.908234:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:3.0:1787784677.908237:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784677.908240:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713600, rc 0) 00000100:00100000:2.0:1787784677.908683:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+40:12252:x1874627728064640:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 3236us (4229us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787784677.908695:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:1.0:1787784677.919859:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784677.919976:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728064768 00000100:00100000:2.0:1787784677.920011:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728064768 00000100:00100000:2.0:1787784677.920078:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 166 00000100:00100000:2.0:1787784677.920090:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+40:12252:x1874627728064768:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:2.0:1787784677.920172:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d8c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.920194:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.920206:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.920244:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.920251:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d8c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.920258:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d8c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.920264:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784677.920268:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d8c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.920277:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d8c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.920289:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784677.920292:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784677.920296:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d8c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784677.920314:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9d8c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784677.920401:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+40:12252:x1874627728064768:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 313us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784677.920410:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 166 00000100:00100000:0.0:1787784677.927064:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784677.927173:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728065024 00000100:00100000:1.0:1787784677.927185:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728065024 00000100:00100000:1.0:1787784677.927264:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:1.0:1787784677.927276:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+40:12252:x1874627728065024:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1787784677.927828:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+41:12252:x1874627728065024:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 553us (774us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787784677.927838:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:0.0:1787784678.391621:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784678.391741:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728065280 00000100:00100000:1.0:1787784678.391751:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728065280 00000100:00100000:1.0:1787784678.391858:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00100000:1.0:1787784678.391871:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+41:12284:x1874627728065280:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:1.0:1787784678.391896:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784678.391919:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c0d expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784678.392044:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d8d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784678.392074:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784678.392086:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784678.392099:0:14535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787784678.392203:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c0d expref: 44 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784678.392221:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d8d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c0d expref: 43 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784678.392229:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:1.0:1787784678.392232:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784678.392236:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602800, rc 0) 00000100:00100000:1.0:1787784678.392303:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+43:12284:x1874627728065280:12345-192.168.202.41@tcp:101:cat.0 Request processed in 435us (816us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1787784678.392311:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00080000:3.0:1787784678.392994:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784678.395832:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784678.395981:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728065536 00000100:00100000:2.0:1787784678.395991:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728065536 00000100:00100000:2.0:1787784678.396046:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:2.0:1787784678.396056:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+43:12284:x1874627728065536:12345-192.168.202.41@tcp:35:cat.0 00000100:00100000:2.0:1787784678.396370:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+44:12284:x1874627728065536:12345-192.168.202.41@tcp:35:cat.0 Request processed in 315us (609us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787784678.396380:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:0.0:1787784678.398044:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784678.398699:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728065664 00000100:00100000:1.0:1787784678.398709:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728065664 00000100:00100000:1.0:1787784678.398803:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:1.0:1787784678.398815:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+44:2405:x1874627728065664:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784678.398833:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784678.398864:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d8d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c0d expref: 44 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784678.398904:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:1.0:1787784678.398909:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784678.398963:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+43:2405:x1874627728065664:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 151us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784678.398971:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:0.0:1787784678.480505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784678.481516:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728065920 00000100:00100000:1.0:1787784678.481527:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728065920 00000100:00100000:1.0:1787784678.481593:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 168 00000100:00100000:1.0:1787784678.481605:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+43:12290:x1874627728065920:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:1.0:1787784678.481630:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784678.481634:0:7991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787784678.481662:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9d837 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72be3 expref: 43 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784678.481682:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:1.0:1787784678.481687:0:7991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784678.481701:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d8df lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c14 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784678.481995:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784678.482011:0:7991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c06 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784678.482021:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784678.482076:0:7991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c06 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784678.482091:0:7991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d8b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c06 expref: 43 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784678.482107:0:7991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7991:1874627750153088:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784678.482221:0:7991:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784678.490402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784678.490510:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728066048 00000100:00100000:0.0:1787784678.490521:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728066048 00000100:00100000:1.0:1787784678.490541:0:7991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7991:1874627750153088:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784678.490565:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d8b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c06 expref: 44 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784678.490571:0:7991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784678.490627:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 88 00000100:00100000:0.0:1787784678.490639:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4db840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+44:2405:x1874627728066048:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784678.490662:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784678.490669:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d8b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c06 expref: 44 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784678.490682:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c06 expref: 44 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784678.490707:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9d8b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c06 expref: 44 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784678.490724:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784678.490730:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784678.490759:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784678.490813:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784678.490861:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784678.490913:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4db840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+43:2405:x1874627728066048:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 276us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784678.490922:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 88 00010000:00010000:2.0:1787784678.491001:0:7991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.491011:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784678.491029:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787784678.491156:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9d8df lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c14 expref: 44 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.491172:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c14 expref: 43 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.491180:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784678.491189:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787784678.491192:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602c00, rc 0) 00000100:00100000:2.0:1787784678.491234:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+43:12290:x1874627728065920:12345-192.168.202.41@tcp:101:dd.0 Request processed in 9632us (10741us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1787784678.491241:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 168 00000100:00100000:3.0:1787784678.512626:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784678.514041:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728066176 00000100:00100000:2.0:1787784678.514053:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728066176 00000100:00100000:2.0:1787784678.514124:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 169 00000100:00100000:2.0:1787784678.514135:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2609a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+43:12290:x1874627728066176:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:2.0:1787784678.514158:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784678.514177:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9d8f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c1b expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.514209:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9d8fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.514222:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9d8fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.514232:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9d8fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.514369:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9d8f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c1b expref: 45 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.514387:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9d8fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c1b expref: 44 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.514396:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784678.514404:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787784678.514557:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183e00, rc 0) 00000100:00100000:2.0:1787784678.514629:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2609a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+44:12290:x1874627728066176:12345-192.168.202.41@tcp:101:dd.0 Request processed in 495us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784678.514637:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 169 00000100:00100000:0.0:1787784678.520317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784678.520426:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728066432 00000100:00100000:2.0:1787784678.520437:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728066432 00000100:00100000:2.0:1787784678.520502:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 170 00000100:00100000:2.0:1787784678.520513:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+44:12290:x1874627728066432:12345-192.168.202.41@tcp:36:dd.0 00010000:00010000:2.0:1787784678.520741:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d902 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.520760:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d902 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.520807:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d902 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784678.521211:0:14535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787784678.521237:0:14535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dd18057 reply state 000000000cf32af2 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d902 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.521252:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d902 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.521261:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784678.521264:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784678.521268:0:14535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784678.521370:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+47:12290:x1874627728066432:12345-192.168.202.41@tcp:36:dd.0 Request processed in 858us (1061us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787784678.521379:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 170 00000020:00080000:2.0:1787784678.521398:0:14535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787784678.534123:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750153216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784678.534223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784678.534797:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750153344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784678.534835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784678.534931:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750153344 00000100:00100000:0.0:1787784678.534939:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750153344 00000100:00100000:0.0:1787784678.535014:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787784678.535025:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750153344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784678.535055:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787784678.535101:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750153344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784678.535108:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787784678.535150:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750153344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784678.535381:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784678.535391:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750153472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784678.535433:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784678.535664:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750153472 00000100:00100000:2.0:1787784678.535670:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750153472 00000100:00100000:2.0:1787784678.535715:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787784678.535723:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750153472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784678.535735:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787784678.535797:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750153472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784678.535804:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1787784678.535822:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784678.535925:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750153216 00000100:00100000:1.0:1787784678.535930:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750153216 00000100:00100000:1.0:1787784678.535980:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787784678.535987:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c260a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750153216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784678.536011:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787784678.536057:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c260a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750153216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784678.536063:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787784678.536185:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750153216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784678.536515:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750153472:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787784678.923554:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784678.937166:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784678.937310:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728066560 00000100:00100000:2.0:1787784678.937348:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728066560 00000100:00100000:2.0:1787784678.937416:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 171 00000100:00100000:2.0:1787784678.937426:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+47:12304:x1874627728066560:12345-192.168.202.41@tcp:101:stat.0 00010000:00010000:2.0:1787784678.937451:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784678.937473:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9d909 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c22 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.937538:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9d910 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.937553:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9d910 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.937565:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9d910 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.937595:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9d917 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.937603:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9d917 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.937611:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9d917 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.937972:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9d91e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.937986:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c14 expref: 48 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.937996:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9d91e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.938030:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c14 expref: 48 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.938045:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c14 expref: 48 pid: 7991 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784678.938059:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f534ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874627750153600:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784678.938280:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784678.948067:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784678.948242:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f534ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874627750153600:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784678.948274:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9d91e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784678.953033:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728066816 00000100:00100000:1.0:1787784678.953050:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728066816 00000100:00100000:1.0:1787784678.953142:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:1.0:1787784678.953154:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2663c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+49:6179:x1874627728066816:12345-192.168.202.41@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787784678.953499:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2663c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+50:6179:x1874627728066816:12345-192.168.202.41@tcp:35:ldlm_bl.0 Request processed in 347us (5442us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1787784678.953524:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:0.0:1787784678.964311:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784678.966136:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728066944 00000100:00100000:2.0:1787784678.966152:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728066944 00010000:00010000:2.0:1787784678.966221:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c14 expref: 50 pid: 7991 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784678.966263:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 89 00000100:00100000:2.0:1787784678.966271:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+50:2406:x1874627728066944:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784678.966285:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784678.966291:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c14 expref: 50 pid: 7991 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.966304:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c14 expref: 50 pid: 7991 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.966340:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9d8e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c14 expref: 50 pid: 7991 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.966357:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784678.966362:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9d91e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.966372:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9d91e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.966380:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9d91e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784678.966414:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784678.966485:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+49:2406:x1874627728066944:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 214us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784678.966493:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 89 00010000:00010000:3.0:1787784678.968438:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9d91e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968456:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9d91e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784678.968524:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787784678.968547:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787784678.968578:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9d91e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968595:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9d91e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968606:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9d910 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968612:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9d910 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968619:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9d910 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968623:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784678.968628:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9d910 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968634:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9d910 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968648:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:3.0:1787784678.968651:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784678.968654:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9d910 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968660:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9d910 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968673:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9d917 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968688:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9d917 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968693:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9d917 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968697:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784678.968699:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9d917 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968705:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9d917 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968713:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67200) 00010000:00010000:3.0:1787784678.968715:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784678.968717:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9d917 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968722:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9d917 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968759:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9d909 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c22 expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968842:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9d91e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c22 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784678.968850:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:3.0:1787784678.968852:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784678.968861:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183c00, rc 0) 00000100:00100000:3.0:1787784678.968969:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+48:12304:x1874627728066560:12345-192.168.202.41@tcp:101:stat.0 Request processed in 31542us (31810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784678.968987:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 171 00000100:00100000:3.0:1787784679.046195:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750153728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784679.046278:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784679.046926:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750154112:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.046966:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784679.046999:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750154624:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.047026:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784679.047044:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750155136:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.047065:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784679.047083:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787784679.047089:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750153984:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.047109:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784679.047126:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750154496:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.047146:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784679.047160:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c42ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750155008:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.047181:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784679.047206:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750154624 00000100:00100000:3.0:1787784679.047212:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750154624 00000100:00100000:3.0:1787784679.047258:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750155136 00000100:00100000:3.0:1787784679.047261:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750155136 00000100:00100000:3.0:1787784679.047278:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750153984 00000100:00100000:3.0:1787784679.047281:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750153984 00000100:00100000:3.0:1787784679.047290:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750154496 00000100:00100000:3.0:1787784679.047293:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750154496 00000100:00100000:3.0:1787784679.047335:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750155008 00000100:00100000:3.0:1787784679.047339:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750155008 00000100:00100000:3.0:1787784679.047358:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787784679.047366:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750154624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.047436:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750154624:12345-0@lo:400:kworker.0 Request processed in 71us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784679.047444:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787784679.047462:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787784679.047469:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c78083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750155136:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1787784679.048005:0:9926:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419297235736ns, next at 420297232727ns, rc = 0 00000100:00100000:0.0:1787784679.048987:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750154240:0@lo:400:kworker.0 00000100:00100000:0.0:1787784679.049063:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784679.049087:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c40c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750154752:0@lo:400:kworker.0 00000100:00100000:0.0:1787784679.049108:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784679.049136:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750155264:0@lo:400:kworker.0 00000100:00100000:0.0:1787784679.049153:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784679.049173:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787784679.049179:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750153856:0@lo:400:kworker.0 00000100:00100000:0.0:1787784679.049201:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784679.049217:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750154368:0@lo:400:kworker.0 00000100:00100000:0.0:1787784679.049237:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784679.049248:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c42cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750154880:0@lo:400:kworker.0 00000100:00100000:0.0:1787784679.049263:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784679.049273:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750155392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784679.049290:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784679.049330:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750154752 00000100:00100000:0.0:1787784679.049336:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750154752 00000100:00100000:0.0:1787784679.049370:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750155264 00000100:00100000:0.0:1787784679.049372:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750155264 00000100:00100000:0.0:1787784679.049384:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750154880 00000100:00100000:0.0:1787784679.049386:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750154880 00000100:00100000:0.0:1787784679.049398:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787784679.049796:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c78083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750155136:12345-0@lo:400:kworker.0 Request processed in 2326us (2728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784679.049806:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787784679.049964:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750153856 00000100:00100000:2.0:1787784679.049969:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750153856 00000100:00100000:2.0:1787784679.050005:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1787784679.050013:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750153856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.050068:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750153856:12345-0@lo:400:kworker.0 Request processed in 56us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.050074:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1787784679.050099:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750153728 00000100:00100000:2.0:1787784679.050103:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750153728 00000100:00100000:2.0:1787784679.050123:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750155392 00000100:00100000:2.0:1787784679.050125:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750155392 00000100:00100000:2.0:1787784679.050136:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787784679.050141:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f534ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750153728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787784679.050162:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787784679.050190:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f534ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750153728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (3913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.050197:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787784679.050205:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787784679.050211:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3781680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874627750155392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784679.050218:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787784679.050236:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3781680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874627750155392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 26us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.050242:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787784679.050259:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750154112 00000100:00100000:2.0:1787784679.050262:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750154112 00000100:00100000:2.0:1787784679.050275:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750154368 00000100:00100000:2.0:1787784679.050277:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750154368 00000100:00100000:2.0:1787784679.050286:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787784679.050301:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750154112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.050347:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750154112:12345-0@lo:400:kworker.0 Request processed in 47us (3380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.050353:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787784679.050364:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787784679.050369:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750154368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.050392:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750154368:12345-0@lo:400:kworker.0 Request processed in 24us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.050397:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787784679.051123:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750154240 00000100:00100000:3.0:1787784679.051130:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750154240 00000100:00100000:3.0:1787784679.051159:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787784679.051166:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750153984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.051217:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750153984:12345-0@lo:400:kworker.0 Request processed in 52us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784679.051224:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787784679.051238:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787784679.051244:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c780a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750154496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.051273:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c780a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750154496:12345-0@lo:400:kworker.0 Request processed in 29us (4126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784679.051279:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787784679.051291:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787784679.051297:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750155008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.051352:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750155008:12345-0@lo:400:kworker.0 Request processed in 55us (4169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784679.051358:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787784679.051371:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787784679.051377:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3781e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750154240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784679.053865:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3783c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750154752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784679.053970:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3783c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750154752:12345-0@lo:400:kworker.0 Request processed in 131us (4860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784679.054282:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3781e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750154240:12345-0@lo:400:kworker.0 Request processed in 29us (2342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784679.054295:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787784679.054458:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750153984:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.054473:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750154496:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.054486:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c42ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750155008:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.054794:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750154112:0@lo:400:kworker.0 00010000:00080000:3.0:1787784679.054812:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c40c4b40 x1874627750154624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784679.054833:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750154624:0@lo:400:kworker.0 00010000:00080000:3.0:1787784679.054848:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c562ad00 x1874627750155136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784679.054857:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750155136:0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.065257:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787784679.065290:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c37812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750155264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.065423:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c37812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750155264:12345-0@lo:400:kworker.0 Request processed in 152us (16268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.065433:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787784679.065467:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787784679.065476:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3780b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750154880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.065523:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3780b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750154880:12345-0@lo:400:kworker.0 Request processed in 48us (16258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.065529:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1787784679.065558:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784679.065564:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784679.065567:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784679.065615:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750153856:0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.065645:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750154368:0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.065658:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c42cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750154880:0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.065700:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750155392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784679.065716:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750154240:0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.065728:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c40c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750154752:0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.065738:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750155264:0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.065756:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750153728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784679.066022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784679.066143:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728067200 00000100:00100000:2.0:1787784679.066151:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728067200 00000100:00100000:2.0:1787784679.066191:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 172 00000100:00100000:2.0:1787784679.066198:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2661e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+48:12310:x1874627728067200:12345-192.168.202.41@tcp:36:truncate.0 00010000:00010000:2.0:1787784679.066258:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784679.066286:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9d91e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c22 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.066303:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784679.066309:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784679.066487:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d925 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.066502:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.066513:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784679.066557:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:2.0:1787784679.066588:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d21d1e4a reply state 000000005a2cd4da transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.066601:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d925 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.066609:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784679.066611:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784679.066614:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784679.066706:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2661e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+50:12310:x1874627728067200:12345-192.168.202.41@tcp:36:truncate.0 Request processed in 507us (687us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787784679.066714:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 172 00000020:00080000:2.0:1787784679.066718:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787784679.076114:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787784679.223811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784679.225429:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728067328 00000100:00100000:0.0:1787784679.225458:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728067328 00000100:00100000:0.0:1787784679.225535:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 173 00000100:00100000:0.0:1787784679.225547:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+50:12324:x1874627728067328:12345-192.168.202.41@tcp:101:stat.0 00010000:00010000:0.0:1787784679.225574:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784679.225596:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d92c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c29 expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225682:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d933 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225696:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d933 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225707:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d933 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225717:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d93a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225724:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d93a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225730:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d93a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225857:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d941 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225867:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225873:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784679.225920:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787784679.225925:0:11332:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784679.225945:0:11332:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225957:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225966:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d933 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225972:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d933 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225978:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d933 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225983:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784679.225986:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d933 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.225994:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d933 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.226006:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:0.0:1787784679.226009:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784679.226013:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d933 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.226019:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d933 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.226048:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d93a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.226054:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d93a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.226060:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d93a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.226065:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784679.226068:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d93a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.226075:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d93a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.226083:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67200) 00010000:00010000:0.0:1787784679.226086:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784679.226089:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d93a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.226096:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d93a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.226123:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9d92c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c29 expref: 52 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.226135:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d941 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c29 expref: 51 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.226152:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784679.226155:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784679.226157:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629200, rc 0) 00000100:00100000:0.0:1787784679.226224:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+51:12324:x1874627728067328:12345-192.168.202.41@tcp:101:stat.0 Request processed in 681us (2458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784679.226232:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 173 00000100:00100000:2.0:1787784679.317459:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784679.318394:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728067584 00000100:00100000:3.0:1787784679.318414:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728067584 00000100:00100000:3.0:1787784679.318510:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 174 00000100:00100000:3.0:1787784679.318525:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2662940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+51:12334:x1874627728067584:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1787784679.318587:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784679.318619:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d948 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784679.318830:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787784679.318969:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d948 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c30 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.318987:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5138800) 00010000:00010000:3.0:1787784679.318991:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787784679.318997:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d948 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c30 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.319016:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712e00, rc 0) 00000100:00100000:3.0:1787784679.319106:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2662940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+52:12334:x1874627728067584:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 584us (1659us total) trans 4294967448 rc 301/301 00000100:00100000:3.0:1787784679.319114:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 174 00000100:00100000:1.0:1787784679.323450:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784679.324097:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728067840 00000100:00100000:2.0:1787784679.324110:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728067840 00000100:00100000:2.0:1787784679.324180:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:2.0:1787784679.324202:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f0041450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+52:12334:x1874627728067840:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1787784679.324716:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f0041450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+53:12334:x1874627728067840:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 525us (1276us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787784679.324726:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:2.0:1787784679.397190:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784679.398804:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728068096 00000100:00100000:1.0:1787784679.398819:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728068096 00000100:00100000:1.0:1787784679.399150:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 175 00000100:00100000:1.0:1787784679.399160:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2663c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+53:12340:x1874627728068096:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1787784679.399186:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784679.399208:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d956 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c37 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784679.399648:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784679.399667:0:7991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d941 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c29 expref: 54 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784679.399676:0:7991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784679.399711:0:7991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d941 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c29 expref: 54 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784679.399725:0:7991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d941 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c29 expref: 54 pid: 11332 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784679.399740:0:7991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7991:1874627750155520:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784679.400640:0:7991:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32180 going to sleep for 11 seconds 00000100:00100000:2.0:1787784679.405985:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784679.406672:0:7991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7991:1874627750155520:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784679.406711:0:7991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784679.409593:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728068224 00000100:00100000:0.0:1787784679.409610:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728068224 00010000:00010000:0.0:1787784679.409683:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d941 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c29 expref: 55 pid: 11332 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784679.409729:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 90 00000100:00100000:0.0:1787784679.409743:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff476d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+55:2405:x1874627728068224:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784679.409837:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784679.409846:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d941 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c29 expref: 55 pid: 11332 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.409864:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d941 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c29 expref: 55 pid: 11332 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.409889:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d941 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c29 expref: 55 pid: 11332 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.409913:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784679.409919:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.409946:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.409956:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.409995:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784679.410058:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff476d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+54:2405:x1874627728068224:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 317us (4094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784679.410070:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 90 00010000:00010000:3.0:1787784679.410090:0:7991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.410108:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784679.410139:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787784679.410634:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9d956 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c37 expref: 55 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.410660:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c37 expref: 54 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.410686:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:3.0:1787784679.410689:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787784679.410693:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602a00, rc 0) 00000100:00100000:3.0:1787784679.410811:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2663c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+54:12340:x1874627728068096:12345-192.168.202.41@tcp:101:bash.0 Request processed in 11608us (13586us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787784679.410821:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 175 00000100:00100000:2.0:1787784679.416853:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784679.416978:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728068480 00000100:00100000:0.0:1787784679.416991:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728068480 00000100:00100000:0.0:1787784679.417068:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 176 00000100:00100000:0.0:1787784679.417082:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+54:12340:x1874627728068480:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:0.0:1787784679.417448:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d96b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.417472:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d96b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.417485:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d96b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784679.417541:0:11332:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:0.0:1787784679.417564:0:11332:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007735732f reply state 00000000f5a3e2b3 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d96b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.417578:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d96b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.417611:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784679.417614:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787784679.417619:0:11332:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787784679.417751:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+57:12340:x1874627728068480:12345-192.168.202.41@tcp:36:bash.0 Request processed in 672us (913us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787784679.417760:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 176 00000020:00080000:0.0:1787784679.417810:0:11332:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787784679.422993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784679.423351:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728068608 00000100:00100000:3.0:1787784679.423374:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728068608 00000100:00100000:3.0:1787784679.423449:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 177 00000100:00100000:3.0:1787784679.423462:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+57:12340:x1874627728068608:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1787784679.423495:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784679.423521:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d972 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c3e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.423646:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d979 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.423665:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c37 expref: 58 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.423676:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d979 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.423722:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c37 expref: 58 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.423739:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c37 expref: 58 pid: 7991 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784679.423828:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750155648:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787784679.423937:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784679.428837:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784679.428941:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728068736 00000100:00100000:2.0:1787784679.428958:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728068736 00010000:00010000:2.0:1787784679.429027:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c37 expref: 59 pid: 7991 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784679.429111:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 91 00000100:00100000:2.0:1787784679.429124:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+59:2406:x1874627728068736:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784679.429148:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784679.429156:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c37 expref: 59 pid: 7991 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.429170:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c37 expref: 59 pid: 7991 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.429202:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784679.429207:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d979 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.429219:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.429227:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d979 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.429252:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784679.429602:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+59:2406:x1874627728068736:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 478us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.429611:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 91 00010000:00010000:3.0:1787784679.429995:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9d95d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c37 expref: 58 pid: 7991 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784679.430017:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750155648:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784679.430114:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.430125:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.430131:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784679.430204:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787784679.430210:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787784679.430241:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.431163:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9d972 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c3e expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.431195:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c3e expref: 57 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.431206:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:3.0:1787784679.431228:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784679.431233:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712400, rc 0) 00000100:00100000:3.0:1787784679.431531:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+57:12340:x1874627728068608:12345-192.168.202.41@tcp:101:bash.0 Request processed in 8070us (8552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784679.431542:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 177 00000100:00100000:1.0:1787784679.436539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784679.436632:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728068992 00000100:00100000:0.0:1787784679.436645:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728068992 00000100:00100000:0.0:1787784679.436744:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:0.0:1787784679.436758:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+57:12340:x1874627728068992:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:0.0:1787784679.437107:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+58:12340:x1874627728068992:12345-192.168.202.41@tcp:35:bash.0 Request processed in 351us (583us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787784679.437116:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:0.0:1787784679.525623:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784679.525811:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728069248 00000100:00100000:2.0:1787784679.525824:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728069248 00000100:00100000:2.0:1787784679.525910:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 178 00000100:00100000:2.0:1787784679.525924:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+58:12349:x1874627728069248:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784679.525978:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784679.526007:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9d980 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784679.526144:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787784679.526275:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9d980 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c45 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.526293:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5138800) 00010000:00010000:2.0:1787784679.526296:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784679.526302:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9d980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c45 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.526342:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4182a00, rc 0) 00000100:00100000:2.0:1787784679.526520:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+59:12349:x1874627728069248:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 599us (914us total) trans 4294967454 rc 301/301 00000100:00100000:2.0:1787784679.526528:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 178 00000100:00100000:1.0:1787784679.531280:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784679.531549:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728069376 00000100:00100000:0.0:1787784679.531563:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728069376 00000100:00100000:0.0:1787784679.531676:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 179 00000100:00100000:0.0:1787784679.531689:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+59:12349:x1874627728069376:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:0.0:1787784679.531827:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d98e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.531850:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d98e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.531864:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d98e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.531915:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d995 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.531923:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.531930:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532038:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d99c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532048:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d99c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532055:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d99c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787784679.532119:0:11332:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d99c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532135:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d98e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532143:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d98e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532150:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d98e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532156:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784679.532161:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d98e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532176:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d98e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532201:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:0.0:1787784679.532205:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784679.532211:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d98e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532218:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d98e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532236:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532242:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d995 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532248:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532254:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784679.532257:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532263:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d995 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532271:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67200) 00010000:00010000:0.0:1787784679.532274:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784679.532277:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d995 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532293:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d995 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532304:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d99c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532319:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d99c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532325:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d99c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532330:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784679.532333:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d99c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532339:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d99c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532348:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784679.532350:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784679.532353:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d99c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.532528:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9d99c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784679.532633:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+59:12349:x1874627728069376:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 944us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784679.532642:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 179 00000100:00100000:1.0:1787784679.539664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784679.540111:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728069632 00000100:00100000:3.0:1787784679.540126:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728069632 00000100:00100000:3.0:1787784679.540205:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:3.0:1787784679.540218:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+59:12349:x1874627728069632:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1787784679.540567:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+60:12349:x1874627728069632:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 350us (917us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787784679.540578:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00000001:00080000:0.0:1787784679.549683:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000004:00080000:0.0:1787784679.549727:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1787784679.549764:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787784679.549793:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8950c3685840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787784679.549800:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8950c24bcf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8950c3685b40 00000020:00080000:0.0:1787784679.549803:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8950c24bc700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8951e1fd6c00 00000020:00080000:1.0:1787784679.550057:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787784679.550133:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787784679.550146:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784679.550176:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750155776:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787784679.550273:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784679.550495:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d7b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550510:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d7b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550519:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d7b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550527:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5ba00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784679.550532:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d7b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550543:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d7b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550566:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8951e0a67100) 00010000:00010000:3.0:1787784679.550589:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784679.550597:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d7b9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550604:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5ba00/0x88ace7295d9d7b9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550632:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d7c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550639:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d7c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550645:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d7c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550649:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5a000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784679.550652:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d7c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550658:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d7c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550665:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:3.0:1787784679.550668:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784679.550670:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d7c0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550676:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a000/0x88ace7295d9d7c0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550691:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d7ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550707:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d7ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550712:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d7ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550716:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784679.550719:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d7ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550725:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d7ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550731:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67200) 00010000:00010000:3.0:1787784679.550734:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784679.550736:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d7ff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550742:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d7ff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550756:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d902 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550762:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d902 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550797:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d902 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550802:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784679.550811:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d902 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550817:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d902 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550825:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:3.0:1787784679.550828:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784679.550830:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d902 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550836:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d902 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550849:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d925 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550856:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d925 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550862:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d925 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550867:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784679.550870:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d925 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550876:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d925 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550883:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:3.0:1787784679.550885:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784679.550908:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d925 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550915:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d925 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550927:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d96b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550933:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d96b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550939:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d96b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550944:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784679.550947:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d96b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550953:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d96b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550961:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:3.0:1787784679.550974:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784679.550977:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d96b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.550983:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9d96b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784679.551252:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750155776 00000100:00100000:2.0:1787784679.551262:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750155776 00000100:00100000:2.0:1787784679.551348:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787784679.551362:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9d71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750155776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787784679.551402:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1787784679.551443:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f6de5, atime: 0x6a8f6de5, ctime: 0x6a8f6de5, blocks: 0x8 00010000:00010000:2.0:1787784679.551450:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002eef094/0x88ace7295d9d9a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.551468:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1787784679.551480:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784679.551488:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002eef094/0x88ace7295d9d9a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.551505:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002eef094/0x88ace7295d9d9a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.551514:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002eef094/0x88ace7295d9d9a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.551520:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002eef094/0x88ace7295d9d9a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.551545:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787784679.551747:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9d71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1874627750155776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 388us (1473us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787784679.551755:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:1.0:1787784679.552701:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784679.552714:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002eef094/0x88ace7295d9d9a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784679.552727:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784679.552732:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002eef094/0x88ace7295d9d9a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784679.552743:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002eef094/0x88ace7295d9d9a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784679.552765:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002eef094/0x88ace7295d9d9a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784679.552801:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002eef094/0x88ace7295d9d9a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784679.552843:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784679.552846:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784679.552848:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787784679.552910:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8950c36ca580/2, rc 0, transno 4294967308 00000100:00100000:1.0:1787784679.552919:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750155776:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787784679.624621:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784679.624831:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728069888 00000100:00100000:2.0:1787784679.624845:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728069888 00000100:00100000:2.0:1787784679.624931:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 180 00000100:00100000:2.0:1787784679.624944:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2666940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+17:12353:x1874627728069888:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784679.624986:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784679.625015:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9d9aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c4c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625122:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d9b1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625164:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d9b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625179:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d9b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625197:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d9b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625205:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625213:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625656:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d9bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625668:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d9bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625677:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d9bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784679.625689:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787784679.625843:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d9b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625852:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d9b1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625860:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d9b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625877:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784679.625882:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d9b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625900:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d9b1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625916:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784679.625920:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784679.625925:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d9b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625933:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9d9b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625949:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.625956:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d9b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.626021:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d9b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.626028:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784679.626031:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d9b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.626038:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d9b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.626058:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67f00) 00010000:00010000:2.0:1787784679.626061:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784679.626064:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d9b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.626070:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d9b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.626126:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9d9aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c4c expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.626142:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d9bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c4c expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.626149:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784679.626151:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784679.626154:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4182800, rc 0) 00000100:00100000:2.0:1787784679.626249:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2666940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+19:12353:x1874627728069888:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1308us (1644us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787784679.626528:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 180 00000100:00100000:3.0:1787784679.629407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784679.629456:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784679.629655:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728070016 00000100:00100000:2.0:1787784679.629668:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728070016 00000100:00100000:2.0:1787784679.629745:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 181 00000100:00100000:2.0:1787784679.629758:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+19:12353:x1874627728070016:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:2.0:1787784679.629901:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.629922:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.629956:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.630010:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.630018:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.630026:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.630033:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784679.630039:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.630047:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.630062:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784679.630065:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784679.630070:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.630077:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784679.630162:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+19:12353:x1874627728070016:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 406us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.630171:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 181 00000100:00100000:1.0:1787784679.630690:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728070144 00000100:00100000:1.0:1787784679.630698:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728070144 00000100:00100000:1.0:1787784679.630752:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:1.0:1787784679.630761:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+19:2405:x1874627728070144:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784679.630814:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784679.630835:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182800/0x88ace7295d9d9bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c4c expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784679.630851:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:1.0:1787784679.630856:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784679.630897:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+18:2405:x1874627728070144:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 137us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784679.630905:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:1.0:1787784679.632751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784679.632876:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728070400 00000100:00100000:0.0:1787784679.632887:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728070400 00000100:00100000:0.0:1787784679.632950:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:0.0:1787784679.632962:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+18:12353:x1874627728070400:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:0.0:1787784679.633268:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+19:12353:x1874627728070400:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 306us (524us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1787784679.633276:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:2.0:1787784679.818433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784679.821107:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728070656 00000100:00100000:0.0:1787784679.821129:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728070656 00000100:00100000:0.0:1787784679.821277:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 182 00000100:00100000:0.0:1787784679.821290:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3577c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+19:12371:x1874627728070656:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:0.0:1787784679.821331:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784679.821368:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d9d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c53 expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.821508:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d9db lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.821527:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d9db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.821558:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d9db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784679.821589:0:14535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787784679.821731:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9d9d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c53 expref: 22 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.821753:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d9db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c53 expref: 21 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.821762:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784679.821817:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787784679.821822:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628800, rc 0) 00000100:00100000:0.0:1787784679.821919:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3577c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12371:x1874627728070656:12345-192.168.202.41@tcp:101:cat.0 Request processed in 631us (3501us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787784679.821929:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 182 00000100:00100000:1.0:1787784679.867064:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784679.867250:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728070784 00000100:00100000:2.0:1787784679.867716:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728070784 00000100:00100000:2.0:1787784679.868201:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 183 00000100:00100000:2.0:1787784679.868225:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12372:x1874627728070784:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784679.868288:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784679.868327:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c5a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.868873:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9d9f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.868905:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9d9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.868920:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9d9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784679.868978:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787784679.868982:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787784679.869008:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9d9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.869045:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c5a expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.869069:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9d9f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c5a expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.869079:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784679.869083:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784679.869107:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4182a00, rc 0) 00000100:00100000:2.0:1787784679.869219:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+22:12372:x1874627728070784:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1000us (2186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.869228:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 183 00000100:00100000:3.0:1787784679.881397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784679.881528:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728071168 00000100:00100000:1.0:1787784679.881541:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728071168 00000100:00100000:1.0:1787784679.881620:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:1.0:1787784679.881633:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+22:12372:x1874627728071168:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1787784679.882529:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+23:12372:x1874627728071168:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 893us (1143us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787784679.882540:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:1.0:1787784679.892753:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784679.893019:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728071296 00000100:00100000:0.0:1787784679.893032:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728071296 00000100:00100000:0.0:1787784679.893121:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1787784679.893133:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2665680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+23:12372:x1874627728071296:12345-192.168.202.41@tcp:103:lfs.0 00010000:00010000:0.0:1787784679.893154:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787784679.893202:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9d979 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c3e expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.893235:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9d9db lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c53 expref: 22 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.893251:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183a00/0x88ace7295d9d876 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bf8 expref: 21 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.893286:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784679.893293:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784679.893381:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2665680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+20:12372:x1874627728071296:12345-192.168.202.41@tcp:103:lfs.0 Request processed in 250us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784679.893390:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1787784679.896610:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784679.896726:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728071424 00000100:00100000:2.0:1787784679.896739:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728071424 00000100:00100000:2.0:1787784679.896862:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:2.0:1787784679.896875:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+20:12372:x1874627728071424:12345-192.168.202.41@tcp:58:lfs.0 00010000:00010000:2.0:1787784679.897035:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.897058:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.897072:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784679.897225:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787784679.897342:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+20:12372:x1874627728071424:12345-192.168.202.41@tcp:58:lfs.0 Request processed in 468us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.897352:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:3.0:1787784679.925226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784679.926108:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728071552 00000100:00100000:2.0:1787784679.926131:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728071552 00000100:00100000:2.0:1787784679.927352:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:2.0:1787784679.927379:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+20:12374:x1874627728071552:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784679.927415:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784679.927444:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d9fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c61 expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.927578:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.927602:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.927620:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.927643:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.927651:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.927659:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.927958:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9da13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.928088:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9da13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.928097:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9da13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784679.928158:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787784679.928164:0:11332:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787784679.928902:0:11332:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9da13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.928958:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9da13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930384:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930395:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da05 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930403:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930411:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784679.930416:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930426:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930446:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784679.930450:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784679.930456:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930463:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930486:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930492:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930516:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930522:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784679.930525:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930532:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930541:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67f00) 00010000:00010000:2.0:1787784679.930544:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784679.930548:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930554:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930627:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9d9fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c61 expref: 22 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930646:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9da13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c61 expref: 21 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.930655:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784679.930658:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784679.930661:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183c00, rc 0) 00000100:00100000:2.0:1787784679.932422:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12374:x1874627728071552:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 4892us (7049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.932465:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 185 00010000:00010000:2.0:1787784679.949500:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787784680.198493:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787784680.198508:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787784680.198669:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787784680.198679:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787784680.199429:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d24b2d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1874627750155904:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787784680.199570:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c1254480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784680.204749:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d24b2d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1874627750155904:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787784680.205929:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784680.206155:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728071680 00000100:00100000:0.0:1787784680.206166:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728071680 00000100:00100000:0.0:1787784680.206247:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 186 00000100:00100000:0.0:1787784680.206258:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12385:x1874627728071680:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787784680.206301:0:6523:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787784680.206447:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12385:x1874627728071680:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 190us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784680.206456:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 186 00000100:00080000:1.0:1787784680.206954:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784680.220891:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784680.224557:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728071808 00000100:00100000:0.0:1787784680.224579:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728071808 00000100:00100000:0.0:1787784680.224692:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00100000:0.0:1787784680.224712:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12385:x1874627728071808:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787784680.224841:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9da1a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.224865:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9da1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.224880:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9da1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.225927:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9da21 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.225953:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9da21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.225966:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9da21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226001:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9da28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226009:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9da28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226016:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9da28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784680.226075:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787784680.226080:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784680.226198:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9da28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226213:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9da1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226220:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9da1a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226226:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9da1a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226251:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784680.226256:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9da1a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226264:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9da1a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226277:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951f5128c00) 00010000:00010000:0.0:1787784680.226280:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784680.226284:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9da1a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226291:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9da1a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226319:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9da21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226326:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9da21 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226331:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9da21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226336:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784680.226339:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9da21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226356:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9da21 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226373:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8950c23c7d00) 00010000:00010000:0.0:1787784680.226376:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784680.226387:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9da21 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226394:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9da21 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226411:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9da28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226417:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9da28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226423:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9da28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226429:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784680.226432:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9da28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226441:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9da28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226449:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784680.226451:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784680.226454:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9da28 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.226459:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628800/0x88ace7295d9da28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784680.226587:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12385:x1874627728071808:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 Request processed in 1880us (5708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784680.226599:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00100000:3.0:1787784680.230173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784680.235120:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728072064 00000100:00100000:2.0:1787784680.235135:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728072064 00000100:00100000:2.0:1787784680.235219:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 188 00000100:00100000:2.0:1787784680.235229:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12385:x1874627728072064:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784680.235249:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784680.235271:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c68 expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.235396:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.235414:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.235426:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784680.235437:0:14535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787784680.235523:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.235531:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.235537:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.235542:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784680.235562:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.235570:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.235583:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784680.235586:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784680.235591:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.235597:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.235637:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da2f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c68 expref: 23 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.235648:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951f5128c00) 00010000:00010000:2.0:1787784680.235650:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784680.235654:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c68 expref: 23 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.235663:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4182e00, rc 0) 00000100:00100000:2.0:1787784680.235739:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+22:12385:x1874627728072064:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 512us (5581us total) trans 4294967460 rc 301/301 00000100:00100000:2.0:1787784680.235747:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 188 00000100:00100000:2.0:1787784680.250878:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784680.250990:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728072192 00000100:00100000:0.0:1787784680.251000:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728072192 00000100:00100000:0.0:1787784680.251068:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:0.0:1787784680.251078:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+22:12385:x1874627728072192:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787784680.251130:0:6523:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787784680.251250:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+22:12385:x1874627728072192:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 173us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784680.251258:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:1.0:1787784680.255555:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784680.255622:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728072448 00000100:00100000:2.0:1787784680.255633:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728072448 00000100:00100000:2.0:1787784680.255700:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 190 00000100:00100000:2.0:1787784680.255724:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+22:12385:x1874627728072448:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784680.255750:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784680.255754:0:7991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787784680.255835:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9d9f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c5a expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.255854:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784680.255859:0:7991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784680.255873:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da44 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c6f expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787784680.256284:0:7991:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787784680.256465:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.256479:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.256491:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.256553:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9da44 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c6f expref: 24 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.256569:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c6f expref: 23 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.256576:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951e0a67f00) 00010000:00010000:2.0:1787784680.256579:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784680.256590:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183600, rc 0) 00000100:00100000:2.0:1787784680.256656:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+23:12385:x1874627728072448:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 935us (1113us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787784680.256664:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 190 00000100:00100000:0.0:1787784680.270929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784680.271293:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728072704 00000100:00100000:3.0:1787784680.271318:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728072704 00000100:00100000:3.0:1787784680.271407:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:3.0:1787784680.271432:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+23:12385:x1874627728072704:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787784680.271513:0:11332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784680.272219:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9da4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c6f expref: 23 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272250:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951e0a67f00) 00010000:00010000:3.0:1787784680.272277:0:11332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784680.272326:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9da59 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272345:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9da59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272359:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9da59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272381:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9da60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x4624aad7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272390:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9da60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4624aad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272399:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9da60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4624aad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272499:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9da59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272509:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9da59 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272517:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9da59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272525:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784680.272531:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9da59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272652:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9da59 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272664:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:3.0:1787784680.272668:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784680.272673:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9da59 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272680:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9da59 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272694:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9da60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4624aad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272701:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9da60 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4624aad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272931:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9da60 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4624aad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272945:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784680.272949:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9da60 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4624aad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272955:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9da60 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4624aad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272965:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x4624aad7 (ffff8951f511e700) 00010000:00010000:3.0:1787784680.272968:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784680.272971:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9da60 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4624aad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.272977:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9da60 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4624aad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784680.273501:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+22:12385:x1874627728072704:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 2067us (2578us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784680.273512:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:1.0:1787784680.282168:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784680.282298:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728072832 00000100:00100000:3.0:1787784680.282330:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728072832 00000100:00100000:3.0:1787784680.282498:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:3.0:1787784680.282514:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+22:12385:x1874627728072832:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784680.285281:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784680.285348:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9da67 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c76 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.285409:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9da6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.285446:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9da6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.285463:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9da6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.286170:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9da67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c76 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.287965:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9da6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c76 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.287979:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951f511ed00) 00010000:00010000:3.0:1787784680.287981:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787784680.287986:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712c00, rc 0) 00000100:00100000:3.0:1787784680.288097:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+23:12385:x1874627728072832:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 5585us (5942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784680.288110:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:3.0:1787784680.293926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784680.294004:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728073088 00000100:00100000:2.0:1787784680.294020:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728073088 00000100:00100000:1.0:1787784680.294582:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00100000:1.0:1787784680.294598:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c40c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+23:12385:x1874627728073088:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787784680.294693:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9da75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.294712:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9da75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.294724:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9da75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787784680.294953:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787784680.294977:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420544207936ns, next at 421544205363ns, rc = 0 00000004:00010000:1.0:1787784680.295038:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049d9fc86 reply state 000000004f94873e transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9da75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.295052:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9da75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.295060:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951f511ed00) 00010000:00010000:1.0:1787784680.295064:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787784680.295067:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784680.295289:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c40c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+25:12385:x1874627728073088:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 695us (1377us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1787784680.295298:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00100000:0.0:1787784680.307319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784680.307405:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728073216 00000100:00100000:1.0:1787784680.307415:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728073216 00000100:00100000:1.0:1787784680.307481:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:1.0:1787784680.307492:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2361a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+25:12385:x1874627728073216:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784680.307518:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784680.307541:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9da7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c7d expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.307599:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9da7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c7d expref: 26 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.307614:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9da7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c7d expref: 26 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.307635:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951f511ed00) 00010000:00010000:1.0:1787784680.307639:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784680.307660:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603400, rc 0) 00000100:00100000:1.0:1787784680.307728:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2361a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+26:12385:x1874627728073216:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 238us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784680.307736:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:3.0:1787784680.325671:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784680.325883:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728073344 00000100:00100000:1.0:1787784680.325897:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728073344 00000100:00080000:2.0:1787784680.325986:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784680.326013:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:1.0:1787784680.326029:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+6:2406:x1874627728073344:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787784680.326378:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2406:x1874627728073344:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 352us (721us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787784680.326387:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:3.0:1787784680.338038:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784680.342603:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728073600 00000100:00100000:1.0:1787784680.342621:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728073600 00000100:00100000:1.0:1787784680.342712:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:1.0:1787784680.342723:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+26:12385:x1874627728073600:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787784680.343036:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+27:12385:x1874627728073600:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 313us (5017us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1787784680.343045:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:0.0:1787784680.347894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784680.348041:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728073856 00000100:00100000:1.0:1787784680.348052:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728073856 00000100:00100000:1.0:1787784680.348117:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 195 00000100:00100000:1.0:1787784680.348128:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+27:12385:x1874627728073856:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787784680.348262:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+27:12385:x1874627728073856:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 134us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784680.348272:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 195 00000100:00100000:0.0:1787784680.359147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784680.359528:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728073984 00000100:00100000:1.0:1787784680.363160:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728073984 00000100:00100000:1.0:1787784680.363296:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 196 00000100:00100000:1.0:1787784680.363320:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+27:12385:x1874627728073984:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784680.363356:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784680.363386:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9da83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c84 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.363514:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9da8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.363531:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9da8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.363555:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9da8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784680.363615:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787784680.363641:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9da8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.363671:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9da83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c84 expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.363691:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9da8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c84 expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.363701:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951f511ed00) 00010000:00010000:1.0:1787784680.363703:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787784680.363708:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602400, rc 0) 00000100:00100000:1.0:1787784680.368488:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+28:12385:x1874627728073984:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 5160us (9340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784680.368507:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 196 00000100:00100000:2.0:1787784680.375261:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784680.375396:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728074112 00000100:00100000:0.0:1787784680.375406:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728074112 00000100:00100000:0.0:1787784680.375473:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:0.0:1787784680.375485:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2406:x1874627728074112:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784680.375509:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784680.375532:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9da91 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c8b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784680.375558:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6de8, blocks: 0x0 00010000:00010000:0.0:1787784680.375579:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=420s v=(0 0) 00010000:00010000:0.0:1787784680.375597:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784680.375608:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9da91 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c8b expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.375630:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9da91 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c8b expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.375646:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628400, rc 0) 00000100:00100000:0.0:1787784680.375817:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2406:x1874627728074112:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 333us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784680.375826:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:0.0:1787784680.382733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784680.383674:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728074368 00000100:00100000:3.0:1787784680.383693:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728074368 00000100:00100000:3.0:1787784680.384027:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 197 00000100:00100000:3.0:1787784680.384042:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+28:12385:x1874627728074368:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787784680.384220:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+28:12385:x1874627728074368:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 182us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784680.384250:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 197 00000100:00100000:0.0:1787784680.394217:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784680.394912:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728074496 00000100:00100000:1.0:1787784680.394930:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728074496 00000100:00100000:1.0:1787784680.395021:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:1.0:1787784680.395033:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+8:12385:x1874627728074496:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784680.395058:0:8916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784680.395083:0:8916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9da98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c92 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.395125:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9da91 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c8b expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.395135:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784680.395140:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784680.395146:0:8916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9da98 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c92 expref: 9 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.395191:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9da91 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c8b expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.395208:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9da91 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c8b expref: 9 pid: 8436 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784680.395225:0:8916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff479a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750156032:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784680.395643:0:8916:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c12546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784680.399871:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784680.400200:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728074624 00000100:00100000:0.0:1787784680.400213:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728074624 00010000:00010000:0.0:1787784680.400286:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9da91 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c8b expref: 10 pid: 8436 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784680.400537:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:0.0:1787784680.400549:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+10:2405:x1874627728074624:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784680.400569:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784680.400600:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9da91 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c8b expref: 10 pid: 8436 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.400617:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9da91 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c8b expref: 10 pid: 8436 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.400676:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784680.400681:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784680.400691:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9da98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c92 expref: 10 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.400703:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9da98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c92 expref: 10 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.400927:0:8452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9da98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c92 expref: 10 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784680.400948:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4166d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8452:1874627750156160:192.168.202.41@tcp:105: 00000100:00100000:0.0:1787784680.401130:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3631e40 going to sleep for 11 seconds 00010000:00010000:1.0:1787784680.402182:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9da91 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c8b expref: 10 pid: 8436 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784680.402211:0:8916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff479a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750156032:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784680.402246:0:8916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9da98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c92 expref: 9 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.402480:0:8916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603e00, rc 0) 00000100:00100000:1.0:1787784680.402572:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+9:12385:x1874627728074496:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 7539us (8484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784680.402584:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:0.0:1787784680.414095:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784680.414355:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728074752 00000100:00100000:3.0:1787784680.414365:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728074752 00002000:00100000:3.0:1787784680.414434:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8950c4165a40 x1874627728074752/t0(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:561/0 lens 504/0 e 0 to 0 dl 1787784691 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787784680.414447:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c4165a40 with x1874627728074752 ext(0->8) 00002000:00010000:3.0:1787784680.414454:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c4165a40 00000100:00100000:3.0:1787784680.414496:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:3.0:1787784680.414508:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4165a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2406:x1874627728074752:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787784680.414526:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4166d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8452:1874627750156160:192.168.202.41@tcp:105: 00010000:00010000:1.0:1787784680.414631:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784680.414747:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2405:x1874627728074624:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 14153us (14844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784680.414760:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:3.0:1787784680.418214:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4165a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+10:2406:x1874627728074752:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 Request processed in 3689us (4115us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787784680.418233:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00002000:00100000:3.0:1787784680.418251:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8950c4165a40 x1874627728074752/t4294967315(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:561/0 lens 504/448 e 0 to 0 dl 1787784691 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787784680.418263:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c4165a40 with x1874627728074752 ext(0->8) 00002000:00010000:3.0:1787784680.418270:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c4165a40 00000100:00100000:0.0:1787784680.425330:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784680.425444:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728074880 00000100:00100000:1.0:1787784680.425457:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728074880 00000100:00100000:1.0:1787784680.425529:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 198 00000100:00100000:1.0:1787784680.425542:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+28:12385:x1874627728074880:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787784680.432032:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:3.0:1787784680.432053:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:0.0:1787784680.432400:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784680.432425:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750156288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787784680.432499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784680.432548:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750156288 00000100:00100000:0.0:1787784680.432554:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750156288 00000100:00100000:0.0:1787784680.432609:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787784680.432619:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c41643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750156288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787784680.432749:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787784680.432753:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787784680 00002000:00010000:0.0:1787784680.432755:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787784680.432795:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787784680 -> 1787784680 00002000:00010000:0.0:1787784680.432797:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787784680.432838:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c41643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750156288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (339us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787784680.432846:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1787784680.432978:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787784680.433009:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8950c4167480/2, rc 0, transno 4294967316 00000100:00100000:0.0:1787784680.433015:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750156288:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1787784680.433389:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1787784680.433536:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+20:12385:x1874627728074880:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 Request processed in 7994us (8232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784680.433545:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 198 00000020:00080000:0.0:1787784680.433635:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1787784680.433646:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:2.0:1787784680.436113:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9da75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.436136:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9da75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.436145:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9da75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.436154:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784680.436160:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9da75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.436168:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9da75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.436193:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951f511ed00) 00010000:00010000:2.0:1787784680.436196:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787784680.436202:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9da75 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.436209:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9da75 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784680.439093:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784680.439193:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728075008 00000100:00100000:2.0:1787784680.439205:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728075008 00000100:00100000:2.0:1787784680.439313:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:2.0:1787784680.439328:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4166580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+10:2406:x1874627728075008:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787784680.440712:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1787784680.440736:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1787784680.441754:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4166580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2406:x1874627728075008:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 Request processed in 2414us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784680.441918:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:1.0:1787784680.443958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784680.444255:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728075264 00000100:00100000:2.0:1787784680.444265:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728075264 00000100:00100000:2.0:1787784680.444381:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 199 00000100:00100000:2.0:1787784680.444393:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff479a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+19:12385:x1874627728075264:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787784680.444479:0:7991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784680.444506:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9da8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c84 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.444525:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951f511ed00) 00010000:00010000:2.0:1787784680.444531:0:7991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784680.444562:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9da9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.444576:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9da9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.444584:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9da9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784680.444722:0:7991:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014afb085 reply state 0000000059fa11fd transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9da9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.444740:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9da9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.444745:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951f511ed00) 00010000:00010000:2.0:1787784680.444748:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784680.444751:0:7991:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784680.444886:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff479a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+20:12385:x1874627728075264:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 494us (937us total) trans 4294967464 rc 0/0 00000100:00100000:2.0:1787784680.444894:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 199 00000100:00100000:3.0:1787784680.451597:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784680.451737:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728075392 00000100:00100000:0.0:1787784680.451747:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728075392 00000100:00100000:0.0:1787784680.451811:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:0.0:1787784680.451821:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728075392:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787784680.451982:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787784680.451986:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787784680 -> 1787784679 00002000:00010000:0.0:1787784680.451988:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787784677 00002000:00010000:0.0:1787784680.451990:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787784680 -> 1787784679 00002000:00010000:0.0:1787784680.451992:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787784680.452058:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2405:x1874627728075392:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 238us (472us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787784680.452066:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:0.0:1787784680.457024:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784680.457207:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728075648 00000100:00100000:3.0:1787784680.457218:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728075648 00000100:00100000:3.0:1787784680.457282:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 200 00000100:00100000:3.0:1787784680.457292:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c41670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+20:12385:x1874627728075648:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787784680.457379:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.457396:0:14535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9da6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c76 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.457406:0:14535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.457442:0:14535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9da6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c76 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.457457:0:14535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9da6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c76 expref: 20 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784680.457471:0:14535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47da40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14535:1874627750156416:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787784680.457557:0:14535:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784680.462402:0:14535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47da40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14535:1874627750156416:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784680.462433:0:14535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784680.462699:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784680.462792:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728075776 00000100:00100000:0.0:1787784680.462800:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728075776 00010000:00010000:0.0:1787784680.462836:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9da6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c76 expref: 21 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784680.462874:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 93 00000100:00100000:0.0:1787784680.462884:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+21:2406:x1874627728075776:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784680.462899:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784680.462906:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9da6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c76 expref: 21 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.462919:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9da6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c76 expref: 21 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.462941:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9da6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c76 expref: 21 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.462968:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951f511ed00) 00010000:00010000:0.0:1787784680.462972:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.462981:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.462989:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.463010:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784680.463061:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+20:2406:x1874627728075776:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 179us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784680.463069:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 93 00010000:00010000:1.0:1787784680.464089:0:14535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.464115:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.464160:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.464167:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.464175:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.464181:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784680.464185:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.464192:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.464205:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951f511ed00) 00010000:00010000:1.0:1787784680.464208:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787784680.464212:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.464218:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9daa6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784680.464279:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c41670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+19:12385:x1874627728075648:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 Request processed in 6987us (7263us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787784680.464289:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 200 00000100:00100000:3.0:1787784680.469866:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784680.469958:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728075904 00000100:00100000:1.0:1787784680.469978:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728075904 00000100:00100000:1.0:1787784680.470038:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:1.0:1787784680.470049:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2407:x1874627728075904:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787784680.470119:0:8916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.470141:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9da98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c92 expref: 8 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.470150:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784680.470154:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787784680.470158:0:8916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.470194:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9da98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c92 expref: 8 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.470209:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9da98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c92 expref: 8 pid: 8916 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784680.470223:0:8916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750156544:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784680.470298:0:8916:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c12546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784680.482508:0:8916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750156544:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784680.482542:0:8916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784680.492440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784680.492655:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728076032 00000100:00100000:3.0:1787784680.492666:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728076032 00010000:00010000:3.0:1787784680.492709:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9da98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c92 expref: 9 pid: 8916 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784680.492810:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 94 00000100:00100000:3.0:1787784680.492821:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2405:x1874627728076032:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784680.492838:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784680.492862:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9da98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c92 expref: 9 pid: 8916 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.492877:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9da98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c92 expref: 9 pid: 8916 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.492905:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9da98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c92 expref: 9 pid: 8916 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.492921:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784680.492925:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784680.492930:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.492941:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.493108:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784680.493170:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2405:x1874627728076032:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 350us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784680.493178:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 94 00010000:00010000:0.0:1787784680.493479:0:8916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.493490:0:8916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.493513:0:8916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.493521:0:8916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.493530:0:8916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.493538:0:8916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784680.493543:0:8916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.493552:0:8916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.493566:0:8916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.493586:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9daad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784680.493651:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2407:x1874627728075904:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 Request processed in 23603us (23795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784680.493659:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:1.0:1787784680.499011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784680.499199:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728076288 00000100:00100000:3.0:1787784680.499208:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728076288 00000100:00100000:3.0:1787784680.499264:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 201 00000100:00100000:3.0:1787784680.499273:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+19:12385:x1874627728076288:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787784680.499366:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.499383:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9d8fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c1b expref: 19 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.499393:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.499428:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9d8fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c1b expref: 19 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.499444:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9d8fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c1b expref: 19 pid: 11332 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784680.499459:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47e940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750156672:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787784680.499539:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784680.512752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784680.512821:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47e940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750156672:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784680.512863:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784680.512908:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728076416 00000100:00100000:0.0:1787784680.512919:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728076416 00010000:00010000:0.0:1787784680.512962:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9d8fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c1b expref: 20 pid: 11332 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784680.512997:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00100000:0.0:1787784680.513006:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+20:2406:x1874627728076416:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784680.513021:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784680.513028:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9d8fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c1b expref: 20 pid: 11332 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.513040:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9d8fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c1b expref: 20 pid: 11332 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.513061:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9d8fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c1b expref: 20 pid: 11332 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.513074:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:0.0:1787784680.513079:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.513117:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.513125:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784680.513152:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784680.513210:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+19:2406:x1874627728076416:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 205us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784680.513219:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 95 00010000:00010000:2.0:1787784680.513859:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.513869:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.514038:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.514052:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9da7c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c7d expref: 19 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.514061:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.514215:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9da7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c7d expref: 19 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.514244:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9da7c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c7d expref: 19 pid: 14535 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784680.514259:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c37943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750156800:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784680.514343:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0bf93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784680.522974:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784680.523019:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728076544 00000100:00100000:2.0:1787784680.523028:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728076544 00010000:00010000:2.0:1787784680.523080:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9da7c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c7d expref: 20 pid: 14535 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784680.523153:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 96 00000100:00100000:2.0:1787784680.523164:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3795680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+20:2405:x1874627728076544:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784680.523180:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784680.523188:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9da7c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c7d expref: 20 pid: 14535 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.523201:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9da7c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c7d expref: 20 pid: 14535 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.523223:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951f511ed00) 00010000:00010000:2.0:1787784680.523229:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.523239:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.523264:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.523287:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784680.523351:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3795680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+20:2405:x1874627728076544:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 188us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784680.523360:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 96 00010000:00010000:2.0:1787784680.523506:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9da7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c7d expref: 19 pid: 14535 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784680.523524:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c37943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750156800:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784680.523544:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.523553:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.523560:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784680.523677:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1787784680.523826:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:2.0:1787784680.523864:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1787784680.523938:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c37943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874627750156928:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787784680.523986:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784680.524009:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784680.524029:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750156928 00000100:00100000:2.0:1787784680.524034:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750156928 00000100:00100000:2.0:1787784680.524079:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787784680.524086:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1874627750156928:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787784680.524168:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1874627750156928:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784680.524175:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787784680.524209:0:6523:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1787784680.524215:0:6523:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8950c4167480, transno 4294967316 00000100:00100000:2.0:1787784680.524227:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c37943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874627750156928:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787784680.524348:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:2.0:1787784680.524388:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c37943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874627750157056:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787784680.524416:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784680.524431:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0bf9840 going to sleep for 11 seconds 00000100:00100000:2.0:1787784680.524506:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750157056 00000100:00100000:2.0:1787784680.524510:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750157056 00000100:00100000:2.0:1787784680.524535:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787784680.524543:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1874627750157056:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787784680.524693:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6523:x1874627750157056:12345-0@lo:1000:mdt00_002.0 Request processed in 148us (273us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787784680.524703:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787784680.524803:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c37943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874627750157056:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787784680.524834:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.524844:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.524851:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.524867:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784680.524872:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.524879:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.524892:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951f511ed00) 00010000:00010000:2.0:1787784680.524895:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784680.524900:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.524906:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9dabb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.524928:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.524933:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9f7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.524938:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.524943:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784680.524946:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.524952:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9f7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.524970:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:2.0:1787784680.524973:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784680.524976:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9f7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.524982:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9d9f7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.525001:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.525013:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9da13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c61 expref: 22 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.525021:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.525044:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9da13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c61 expref: 22 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784680.525058:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9da13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c61 expref: 22 pid: 11332 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784680.525069:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36d30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750157184:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784680.525123:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3378480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784680.534664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784680.534672:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36d30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874627750157184:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784680.534728:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784680.534819:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728076672 00000100:00100000:1.0:1787784680.534833:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728076672 00010000:00010000:1.0:1787784680.534887:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9da13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c61 expref: 23 pid: 11332 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784680.534933:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 97 00000100:00100000:1.0:1787784680.534945:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+23:2405:x1874627728076672:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784680.534966:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784680.534974:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9da13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c61 expref: 23 pid: 11332 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.534988:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9da13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c61 expref: 23 pid: 11332 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.535012:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9da13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c61 expref: 23 pid: 11332 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.535029:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:1.0:1787784680.535034:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.535043:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.535051:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.535089:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784680.535157:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+22:2405:x1874627728076672:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 214us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784680.535166:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 97 00010000:00010000:3.0:1787784680.535552:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535564:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535582:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535591:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535598:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535605:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784680.535610:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535619:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535635:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:3.0:1787784680.535639:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784680.535644:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535651:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dac2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535670:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535686:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535692:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535697:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784680.535700:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535705:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535714:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951e0a67a00) 00010000:00010000:3.0:1787784680.535716:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787784680.535719:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.535724:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dab4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784680.536031:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12385:x1874627728076288:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 36756us (37026us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787784680.536043:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 201 00000020:00080000:3.0:1787784680.536049:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787784680.536623:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787784680.536634:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787784680.537348:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787784680.537363:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784680.550832:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784680.550884:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728076928 00000100:00100000:1.0:1787784680.550900:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728076928 00000100:00100000:1.0:1787784680.550977:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:1.0:1787784680.550990:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fa974850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12385:x1874627728076928:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787784680.551276:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787784680.551320:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:1.0:1787784680.551356:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603200/0x88ace7295d9dac9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.551374:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603200/0x88ace7295d9dac9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.551385:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603200/0x88ace7295d9dac9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.551395:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603200/0x88ace7295d9dac9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.551402:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603200/0x88ace7295d9dac9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.551426:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603200/0x88ace7295d9dac9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784680.551450:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784680.551496:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784680.551510:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603200/0x88ace7295d9dac9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.551543:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784680.551548:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603200/0x88ace7295d9dac9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.551561:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603200/0x88ace7295d9dac9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784680.551562:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fa974850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+23:12385:x1874627728076928:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 572us (745us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787784680.551593:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 50 00000020:00080000:1.0:1787784680.551600:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787784680.551605:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951f511ed00) 00010000:00010000:3.0:1787784680.551613:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787784680.551619:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603200/0x88ace7295d9dac9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.551628:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603200/0x88ace7295d9dac9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784680.551650:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784680.551652:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784680.551655:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784680.582797:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784680.582822:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff478b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750157312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784680.582896:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784680.582972:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750157312 00000100:00100000:3.0:1787784680.582986:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750157312 00000100:00100000:3.0:1787784680.583076:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787784680.583089:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750157312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784680.583148:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787784680.583328:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750157312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 241us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784680.583339:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787784680.583387:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff478b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750157312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787784680.969244:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787784681.078164:0:14671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787784681.078174:0:14671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787784681.078214:0:14671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787784681.078223:0:14671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787784681.286567:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784681.286614:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728077184 00000100:00100000:2.0:1787784681.286631:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728077184 00000100:00100000:2.0:1787784681.286694:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00100000:2.0:1787784681.286704:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+23:12395:x1874627728077184:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784681.286731:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784681.286753:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9dad0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72c99 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.286881:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183a00/0x88ace7295d9dad7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.286898:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183a00/0x88ace7295d9dad7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.286910:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183a00/0x88ace7295d9dad7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784681.286919:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787784681.287014:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9dad0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c99 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.287031:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183a00/0x88ace7295d9dad7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c99 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.287041:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784681.287044:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787784681.287047:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183a00, rc 0) 00000100:00100000:2.0:1787784681.287103:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+25:12395:x1874627728077184:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 400us (547us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787784681.287125:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00100000:3.0:1787784681.291598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784681.291637:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728077312 00000100:00100000:3.0:1787784681.291647:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728077312 00000100:00100000:3.0:1787784681.291715:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 203 00000100:00100000:3.0:1787784681.291726:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+25:12395:x1874627728077312:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:3.0:1787784681.291829:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dae5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.291847:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dae5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.291859:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dae5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.291873:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9daec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.291881:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9daec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.291887:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9daec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.291959:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9daf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.291967:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9daf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.291974:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9daf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784681.292019:0:11332:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9daf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.292032:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dae5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.292045:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dae5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.292051:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dae5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.292057:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784681.292061:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dae5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.292069:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dae5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.292081:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:3.0:1787784681.292083:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784681.292087:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dae5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.292093:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dae5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.292105:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9daec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.294514:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9daec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.294525:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9daec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.294532:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784681.294545:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9daec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.294554:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9daec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.294570:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951f5138700) 00010000:00010000:3.0:1787784681.294573:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784681.294578:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9daec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.294584:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9daec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.294613:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9daf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.294619:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9daf3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.294625:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9daf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.294629:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784681.294632:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9daf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.294637:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9daf3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.294644:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8951f5138100) 00010000:00010000:3.0:1787784681.294646:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784681.294654:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9daf3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.294660:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9daf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784681.294784:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+25:12395:x1874627728077312:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 3042us (3179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784681.294795:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 203 00000100:00100000:2.0:1787784681.368084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784681.370274:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728077568 00000100:00100000:1.0:1787784681.370291:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728077568 00000100:00100000:1.0:1787784681.370380:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 204 00000100:00100000:1.0:1787784681.370392:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+25:12398:x1874627728077568:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787784681.370417:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784681.370439:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9dafa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ca0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.370515:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9db01 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.370548:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9db01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.370559:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9db01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.370574:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9db08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.370581:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9db08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.370588:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9db08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.370947:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9db0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.370957:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9db0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.370965:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9db0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784681.370974:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787784681.371056:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9db01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371064:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9db01 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371072:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9db01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371085:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784681.371089:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9db01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371096:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9db01 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371411:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:1.0:1787784681.371416:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784681.371421:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9db01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371428:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9db01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371441:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9db08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371447:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9db08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371453:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9db08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371458:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784681.371461:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9db08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371467:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9db08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371484:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8950c26a3500) 00010000:00010000:1.0:1787784681.371486:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784681.371489:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9db08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371495:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9db08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371533:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9dafa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca0 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371546:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9db0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca0 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.371553:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:1.0:1787784681.371555:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784681.371557:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602400, rc 0) 00000100:00100000:1.0:1787784681.371896:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+27:12398:x1874627728077568:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1505us (3822us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1787784681.371905:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 204 00000100:00100000:3.0:1787784681.379036:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784681.379181:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728077696 00000100:00100000:2.0:1787784681.379191:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728077696 00000100:00100000:2.0:1787784681.379254:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 205 00000100:00100000:2.0:1787784681.379266:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+27:12398:x1874627728077696:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:2.0:1787784681.379515:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.379532:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.379542:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.379577:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.379584:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.379591:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.379596:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784681.379600:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.379607:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.379618:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:2.0:1787784681.379621:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784681.379649:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.379657:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784681.379733:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+27:12398:x1874627728077696:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 468us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784681.379741:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 205 00000100:00100000:3.0:1787784681.381932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784681.382023:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728077952 00000100:00100000:0.0:1787784681.382032:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728077952 00000100:00100000:0.0:1787784681.382092:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:0.0:1787784681.382100:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+27:12398:x1874627728077952:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:0.0:1787784681.382459:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+28:12398:x1874627728077952:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 358us (534us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1787784681.382467:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:3.0:1787784681.435252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784681.435514:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728078208 00000100:00100000:0.0:1787784681.435524:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728078208 00000100:00100000:0.0:1787784681.435589:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 206 00000100:00100000:0.0:1787784681.435600:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+28:11930:x1874627728078208:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1787784681.435635:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784681.435660:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9db24 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ca7 expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.435812:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.435841:0:11332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9db0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca0 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.435850:0:11332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.435882:0:11332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9db0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca0 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.435895:0:11332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9db0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca0 expref: 29 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784681.435909:0:11332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c41661c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750157440:192.168.202.41@tcp:104: 00000100:00100000:0.0:1787784681.436203:0:11332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784681.445250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784681.447395:0:11332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c41661c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750157440:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784681.447430:0:11332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784681.449822:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728078336 00000100:00100000:2.0:1787784681.449839:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728078336 00010000:00010000:2.0:1787784681.449895:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9db0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca0 expref: 30 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784681.450073:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 98 00000100:00100000:2.0:1787784681.450085:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff476d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+30:2406:x1874627728078336:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784681.450104:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784681.450126:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9db0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca0 expref: 30 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.450149:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9db0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca0 expref: 30 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.450174:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9db0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca0 expref: 30 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.450193:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:2.0:1787784681.450198:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.450223:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.450231:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.450376:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784681.450438:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff476d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+29:2406:x1874627728078336:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 354us (5198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784681.450446:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 98 00010000:00010000:1.0:1787784681.455450:0:11332:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.455468:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784681.455493:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787784681.455659:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9db24 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca7 expref: 30 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.455699:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca7 expref: 29 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.455710:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:1.0:1787784681.455714:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787784681.455717:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629000, rc 0) 00000100:00100000:1.0:1787784681.455825:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+29:11930:x1874627728078208:12345-192.168.202.41@tcp:101:bash.0 Request processed in 20226us (20582us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1787784681.455836:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 206 00000100:00100000:0.0:1787784681.462589:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784681.462748:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728078464 00000100:00100000:2.0:1787784681.462759:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728078464 00000100:00100000:2.0:1787784681.462850:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 207 00000100:00100000:2.0:1787784681.462860:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c41661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+29:11930:x1874627728078464:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784681.462886:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784681.462911:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72cae expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.462950:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9db40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.462964:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9db40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.462977:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9db40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.463100:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cae expref: 31 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.463437:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9db40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cae expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.463447:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:2.0:1787784681.463450:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787784681.463454:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183000, rc 0) 00000100:00100000:2.0:1787784681.463518:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c41661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+30:11930:x1874627728078464:12345-192.168.202.41@tcp:101:bash.0 Request processed in 659us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784681.463526:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 207 00000100:00100000:1.0:1787784681.466591:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784681.466683:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728078720 00000100:00100000:0.0:1787784681.466695:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728078720 00000100:00100000:0.0:1787784681.466757:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 208 00000100:00100000:0.0:1787784681.466790:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+30:11930:x1874627728078720:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:0.0:1787784681.467434:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9db47 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.467452:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9db47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.467476:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9db47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784681.467520:0:7991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:0.0:1787784681.467545:0:7991:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b7eb647 reply state 00000000deb94777 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9db47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.467557:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9db47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.467565:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:0.0:1787784681.467568:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787784681.467571:0:7991:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787784681.467609:0:7991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:0.0:1787784681.467867:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+34:11930:x1874627728078720:12345-192.168.202.41@tcp:36:bash.0 Request processed in 1100us (1283us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787784681.467876:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 208 00000020:00080000:0.0:1787784681.467881:0:7991:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787784681.478204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784681.478672:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728078848 00000100:00100000:3.0:1787784681.478683:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728078848 00000100:00100000:3.0:1787784681.478808:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 209 00000100:00100000:3.0:1787784681.478820:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+34:11930:x1874627728078848:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1787784681.478848:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784681.478870:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9db4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72cb5 expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.478929:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9db4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cb5 expref: 35 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.478944:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9db4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cb5 expref: 35 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.478974:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:3.0:1787784681.478977:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787784681.478994:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712c00, rc 0) 00000100:00100000:3.0:1787784681.479058:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+35:11930:x1874627728078848:12345-192.168.202.41@tcp:101:bash.0 Request processed in 241us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784681.479066:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 209 00000100:00100000:0.0:1787784681.483552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784681.485565:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728078976 00000100:00100000:2.0:1787784681.485578:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728078976 00000100:00100000:2.0:1787784681.485652:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:2.0:1787784681.485662:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4167840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:11930:x1874627728078976:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784681.485681:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784681.485702:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050e03ed0/0x88ace7295d9db55 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72cbc expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784681.485726:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f6de7, atime: 0x6a8f6de5, ctime: 0x6a8f6de7, blocks: 0x8 00010000:00010000:2.0:1787784681.485748:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787784681.485753:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784681.485802:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050e03ed0/0x88ace7295d9db55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cbc expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.485822:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000050e03ed0/0x88ace7295d9db55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cbc expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.486041:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183600, rc 0) 00000100:00100000:2.0:1787784681.486113:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4167840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:11930:x1874627728078976:12345-192.168.202.41@tcp:101:bash.0 Request processed in 452us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784681.486121:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:2.0:1787784681.489841:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784681.490102:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728079104 00000100:00100000:0.0:1787784681.490113:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728079104 00002000:00010000:0.0:1787784681.490155:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1787784681.490160:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c43b1680 with x1874627728079104 ext(0->18446744073709551615) 00002000:00010000:0.0:1787784681.490173:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c43b1680. 00000100:00100000:0.0:1787784681.490213:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:0.0:1787784681.490224:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2405:x1874627728079104:12345-192.168.202.41@tcp:10:bash.0 00002000:00010000:0.0:1787784681.490513:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787784681.490524:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787784679 -> 1787784681 00002000:00010000:0.0:1787784681.490526:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1787784677 -> 1787784677 00002000:00010000:0.0:1787784681.490529:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787784679 -> 1787784681 00002000:00010000:0.0:1787784681.490532:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787784681.490640:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2405:x1874627728079104:12345-192.168.202.41@tcp:10:bash.0 Request processed in 417us (812us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787784681.490648:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00002000:00010000:0.0:1787784681.490653:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1787784681.490656:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c43b1680 with x1874627728079104 ext(0->18446744073709551615) 00002000:00010000:0.0:1787784681.490661:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c43b1680. 00000100:00100000:0.0:1787784681.579232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784681.579356:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728079232 00000100:00100000:2.0:1787784681.579365:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728079232 00000100:00100000:2.0:1787784681.579429:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 210 00000100:00100000:2.0:1787784681.579438:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4165680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+35:12412:x1874627728079232:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:2.0:1787784681.579515:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db5c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.579534:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.579545:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.579563:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.579570:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.579577:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.579655:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9db6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.579676:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9db6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.579684:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9db6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784681.579735:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9db6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.579746:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.579752:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db5c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580174:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580181:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784681.580186:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580195:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db5c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580208:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784681.580211:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784681.580216:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580223:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580249:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580255:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580260:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580266:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784681.580268:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580275:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580283:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67500) 00010000:00010000:2.0:1787784681.580286:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784681.580288:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580303:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580317:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9db6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580323:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9db6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580329:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9db6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580340:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784681.580343:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9db6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580350:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9db6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580358:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:2.0:1787784681.580360:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784681.580364:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9db6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.580369:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9db6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784681.580490:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4165680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+35:12412:x1874627728079232:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 1051us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784681.580499:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 210 00000100:00100000:3.0:1787784681.636361:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784681.636477:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728079488 00000100:00100000:2.0:1787784681.636486:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728079488 00000100:00100000:2.0:1787784681.636552:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 211 00000100:00100000:2.0:1787784681.636565:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+35:12415:x1874627728079488:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784681.636587:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784681.636608:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9db71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72cc3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.636683:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db78 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.636718:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.636729:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.636745:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.636752:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.636808:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.636923:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9db86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.636933:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9db86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.636940:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9db86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784681.637072:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787784681.637156:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637164:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db78 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637172:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db78 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637187:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784681.637192:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db78 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637201:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db78 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637214:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784681.637217:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784681.637222:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637229:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9db78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637243:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637249:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637255:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637260:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784681.637262:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637268:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637288:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67500) 00010000:00010000:2.0:1787784681.637308:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784681.637313:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db7f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637320:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9db7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637366:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9db71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cc3 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637381:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9db86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cc3 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.637389:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:2.0:1787784681.637391:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787784681.637394:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183400, rc 0) 00000100:00100000:2.0:1787784681.637469:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+37:12415:x1874627728079488:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 906us (1118us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787784681.637477:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 211 00000100:00100000:1.0:1787784681.648227:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784681.648531:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728079616 00000100:00100000:3.0:1787784681.648541:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728079616 00000100:00100000:3.0:1787784681.648604:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 212 00000100:00100000:3.0:1787784681.648614:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+37:12415:x1874627728079616:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:3.0:1787784681.648680:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.648697:0:11332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca7 expref: 37 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.648707:0:11332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.648743:0:11332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca7 expref: 37 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.649036:0:11332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca7 expref: 37 pid: 11332 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784681.649053:0:11332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c42ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750157568:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787784681.649227:0:11332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784681.656678:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784681.657050:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728079872 00000100:00100000:2.0:1787784681.657060:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728079872 00000100:00100000:2.0:1787784681.657118:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:2.0:1787784681.657128:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+38:6179:x1874627728079872:12345-192.168.202.41@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787784681.657453:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+39:6179:x1874627728079872:12345-192.168.202.41@tcp:35:ldlm_bl.0 Request processed in 326us (783us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787784681.657461:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:0.0:1787784681.659875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784681.659965:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728080000 00000100:00100000:3.0:1787784681.659987:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728080000 00010000:00010000:3.0:1787784681.660025:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca7 expref: 39 pid: 11332 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784681.660068:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00100000:3.0:1787784681.660077:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4166940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+39:2405:x1874627728080000:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784681.660091:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784681.660098:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca7 expref: 39 pid: 11332 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.660124:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca7 expref: 39 pid: 11332 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.660149:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:3.0:1787784681.660154:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.660164:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.660454:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.660475:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784681.660535:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4166940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+39:2405:x1874627728080000:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 457us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784681.660543:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 99 00010000:00010000:1.0:1787784681.661696:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9db2b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ca7 expref: 38 pid: 11332 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784681.661716:0:11332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c42ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11332:1874627750157568:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784681.661736:0:11332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.661745:0:11332:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.661761:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.661834:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.661867:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.661874:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.661881:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784681.661885:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.661893:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.661906:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:1.0:1787784681.661908:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787784681.661912:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.661923:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9db94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784681.661990:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+37:12415:x1874627728079616:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 13376us (13774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784681.662001:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 212 00000100:00100000:0.0:1787784681.666134:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784681.666264:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728080256 00000100:00100000:3.0:1787784681.666274:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728080256 00000100:00100000:3.0:1787784681.666359:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:3.0:1787784681.666371:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4167c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+37:12415:x1874627728080256:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1787784681.666617:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4167c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+38:12415:x1874627728080256:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 248us (492us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787784681.666626:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:3.0:1787784681.775387:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784681.775441:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784681.775595:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728080384 00000100:00100000:0.0:1787784681.775608:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728080384 00002000:00100000:0.0:1787784681.775674:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->7) req@ffff8950c42ce1c0 x1874627728080384/t0(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:562/0 lens 496/0 e 0 to 0 dl 1787784692 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784681.775686:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c42ce1c0 with x1874627728080384 ext(0->7) 00002000:00010000:0.0:1787784681.775691:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c42ce1c0 00000100:00100000:0.0:1787784681.775730:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:0.0:1787784681.775741:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c42ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2405:x1874627728080384:12345-192.168.202.41@tcp:4:bash.0 00000100:00100000:2.0:1787784681.776547:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728080512 00000100:00100000:2.0:1787784681.776555:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728080512 00000100:00100000:2.0:1787784681.776602:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:2.0:1787784681.776613:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+12:2405:x1874627728080512:12345-192.168.202.41@tcp:16:kworker.0 00000100:00100000:0.0:1787784681.778315:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c42ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+12:2405:x1874627728080384:12345-192.168.202.41@tcp:4:bash.0 Request processed in 2566us (2929us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787784681.778330:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00002000:00100000:0.0:1787784681.778343:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->7) req@ffff8950c42ce1c0 x1874627728080384/t4294967320(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:562/0 lens 496/448 e 0 to 0 dl 1787784692 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784681.778374:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c42ce1c0 with x1874627728080384 ext(0->7) 00002000:00010000:0.0:1787784681.778381:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c42ce1c0 00000001:00080000:3.0:1787784681.787128:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:3.0:1787784681.787145:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:2.0:1787784681.790065:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728080512:12345-192.168.202.41@tcp:16:kworker.0 Request processed in 13439us (14608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784681.790079:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:3.0:1787784681.790983:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784681.791108:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728080768 00000100:00100000:1.0:1787784681.791117:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728080768 00000100:00100000:1.0:1787784681.791175:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 213 00000100:00100000:1.0:1787784681.791185:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2665680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+38:12425:x1874627728080768:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:1.0:1787784681.791210:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784681.791256:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9db9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72cca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.791341:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dba2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.791357:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dba2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.793014:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dba2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.793055:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dba9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.793068:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.793076:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.793195:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9dbb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.793205:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9dbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.793213:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9dbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784681.793222:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787784681.794490:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dba2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794517:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dba2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794521:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dba2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794525:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784681.794528:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dba2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794534:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dba2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794543:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:1.0:1787784681.794545:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784681.794548:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dba2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794552:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dba2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794561:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794565:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dba9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794569:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794571:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784681.794577:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794581:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dba9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794585:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8950c26a3500) 00010000:00010000:1.0:1787784681.794586:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784681.794588:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dba9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794591:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dba9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794629:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9db9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cca expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794638:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9dbb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cca expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.794642:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:1.0:1787784681.794643:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784681.794645:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602c00, rc 0) 00000100:00100000:1.0:1787784681.794707:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2665680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+40:12425:x1874627728080768:12345-192.168.202.41@tcp:101:cat.0 Request processed in 3524us (3729us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787784681.794716:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 213 00000100:00100000:3.0:1787784681.803304:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784681.806002:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728081024 00000100:00100000:0.0:1787784681.806019:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728081024 00000100:00100000:0.0:1787784681.806101:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:0.0:1787784681.806112:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+40:12425:x1874627728081024:12345-192.168.202.41@tcp:35:cat.0 00000100:00100000:0.0:1787784681.806454:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+41:12425:x1874627728081024:12345-192.168.202.41@tcp:35:cat.0 Request processed in 342us (3172us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787784681.806463:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:0.0:1787784681.836638:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784681.836717:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728081280 00000100:00100000:2.0:1787784681.836727:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728081280 00000100:00100000:2.0:1787784681.836830:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 214 00000100:00100000:2.0:1787784681.836841:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+41:12427:x1874627728081280:12345-192.168.202.41@tcp:36:rm.0 00010000:00010000:2.0:1787784681.836913:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787784681.836940:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9db4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cb5 expref: 41 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.836963:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9dbb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cca expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.836975:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9db86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cc3 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.836986:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9db40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cae expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.836995:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:2.0:1787784681.837000:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784681.837021:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9dbbe lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837049:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9dbbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837059:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9dbbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837086:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dbc5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837093:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dbc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837099:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dbc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837175:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dbcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837184:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dbcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837190:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dbcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784681.837727:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787784681.837737:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 422086967950ns, next at 423086965620ns, rc = 0 00010000:00010000:2.0:1787784681.837829:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9dbd3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837840:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9dbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837861:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9dbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837869:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9dbd3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837875:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9dbd3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837881:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9dbd3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837936:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784681.837958:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dbcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837964:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dbcc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837971:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dbcc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837976:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784681.837982:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dbcc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837989:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dbcc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.837999:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:2.0:1787784681.838003:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787784681.838014:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dbcc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.838022:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dbcc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.838040:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9dbbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.838046:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9dbbe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.838051:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9dbbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.838057:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784681.838060:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9dbbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.838066:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9dbbe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.838074:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784681.838077:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784681.838080:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9dbbe lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.838086:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182e00/0x88ace7295d9dbbe lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784681.838095:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001dd7f935 reply state 00000000738d9ad9 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dbc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.838118:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dbc5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.838125:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67500) 00010000:00010000:2.0:1787784681.838128:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784681.838130:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784681.838228:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+39:12427:x1874627728081280:12345-192.168.202.41@tcp:36:rm.0 Request processed in 1385us (1595us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787784681.838238:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 214 00010000:00010000:0.0:1787784681.840957:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784681.840974:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9dbd3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.840986:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784681.840990:0:10397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9dbd3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.841000:0:10397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9dbd3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.841022:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:0.0:1787784681.841025:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787784681.841031:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9dbd3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.841037:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183e00/0x88ace7295d9dbd3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.841078:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784681.841080:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784681.841082:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784681.936144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784681.936306:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728081536 00000100:00100000:1.0:1787784681.936317:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728081536 00000100:00100000:1.0:1787784681.936389:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 215 00000100:00100000:1.0:1787784681.936401:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+39:12433:x1874627728081536:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1787784681.936443:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784681.936465:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9dbda lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72cd1 expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.936567:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dbe1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.936583:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dbe1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.936593:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dbe1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.936603:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dbe8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.936609:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dbe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.936615:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dbe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787784681.937038:0:14535:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787784681.937192:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dbef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.937202:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dbef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.937211:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dbef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.937258:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dbe1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.937266:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dbe1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.937273:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dbe1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.937278:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784681.937282:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dbe1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.937300:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dbe1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.937312:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:1.0:1787784681.937315:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784681.937320:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dbe1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.937326:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603800/0x88ace7295d9dbe1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784681.937341:0:14535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dab3577d reply state 00000000cfb2bd86 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dbe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.937350:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dbe8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.937357:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67500) 00010000:00010000:1.0:1787784681.937365:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787784681.937368:0:14535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787784681.937398:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9dbda lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd1 expref: 42 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.937412:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dbef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd1 expref: 41 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.937420:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:1.0:1787784681.937422:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784681.937425:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602800, rc 0) 00000100:00100000:1.0:1787784681.937501:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+42:12433:x1874627728081536:12345-192.168.202.41@tcp:101:bash.0 Request processed in 1102us (1367us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787784681.937509:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 215 00000100:00100000:3.0:1787784681.946611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784681.946724:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728081664 00000100:00100000:2.0:1787784681.946733:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728081664 00000100:00100000:2.0:1787784681.946860:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:2.0:1787784681.946875:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c19f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2408:x1874627728081664:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784681.946896:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784681.946922:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026b2fa41/0x88ace7295d9dbfd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72cd8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784681.946952:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784681.946977:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787784681.946983:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784681.946993:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026b2fa41/0x88ace7295d9dbfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd8 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.947015:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026b2fa41/0x88ace7295d9dbfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd8 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.947052:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4182e00, rc 0) 00000100:00100000:2.0:1787784681.947125:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c19f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2408:x1874627728081664:12345-192.168.202.41@tcp:101:bash.0 Request processed in 255us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784681.947133:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00080000:0.0:1787784681.947464:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784681.955071:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784681.955243:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728081792 00000100:00100000:1.0:1787784681.955253:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728081792 00000100:00100000:1.0:1787784681.955320:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:1.0:1787784681.955330:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c41652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+8:12433:x1874627728081792:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1787784681.955350:0:8916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784681.955381:0:8916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72cdf expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.955414:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026b2fa41/0x88ace7295d9dbfd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd8 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.955423:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784681.955428:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784681.955433:0:8916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 9 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.955481:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026b2fa41/0x88ace7295d9dbfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd8 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.955500:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026b2fa41/0x88ace7295d9dbfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd8 expref: 9 pid: 8436 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784681.955515:0:8916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8916:1874627750157696:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784681.955632:0:8916:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2d4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787784681.966222:0:8916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8916:1874627750157696:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784681.966272:0:8916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 9 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.966322:0:8916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603800, rc 0) 00000100:00100000:0.0:1787784681.966508:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c41652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+9:12433:x1874627728081792:12345-192.168.202.41@tcp:101:bash.0 Request processed in 11178us (11450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784681.966518:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:3.0:1787784681.975829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784681.976569:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728081920 00000100:00100000:0.0:1787784681.976585:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728081920 00010000:00010000:0.0:1787784681.976642:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026b2fa41/0x88ace7295d9dbfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd8 expref: 9 pid: 8436 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784681.976693:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 100 00000100:00100000:0.0:1787784681.976704:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2405:x1874627728081920:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784681.976722:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784681.976745:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026b2fa41/0x88ace7295d9dbfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd8 expref: 9 pid: 8436 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.976760:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026b2fa41/0x88ace7295d9dbfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd8 expref: 9 pid: 8436 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.976848:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026b2fa41/0x88ace7295d9dbfd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd8 expref: 9 pid: 8436 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.976865:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784681.976870:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784681.976878:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 8 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.976890:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 8 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.976926:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 8 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784681.976942:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4165e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1874627750157824:192.168.202.41@tcp:105: 00000100:00100000:0.0:1787784681.977031:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784681.987144:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784681.987259:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4165e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1874627750157824:192.168.202.41@tcp:105: 00010000:00010000:0.0:1787784681.987299:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784681.987417:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728082176 00000100:00100000:1.0:1787784681.987425:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728082176 00000100:00100000:1.0:1787784681.987483:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:1.0:1787784681.987493:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+42:12433:x1874627728082176:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:0.0:1787784681.987963:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2405:x1874627728081920:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 11259us (12147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784681.987975:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 100 00010000:00010000:3.0:1787784681.993617:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784681.994044:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+43:12433:x1874627728082176:12345-192.168.202.41@tcp:35:bash.0 Request processed in 6538us (6903us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1787784681.994059:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:2.0:1787784682.204703:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.204929:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728082304 00000100:00100000:3.0:1787784682.204951:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728082304 00000100:00100000:3.0:1787784682.205045:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 216 00000100:00100000:3.0:1787784682.205060:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fa967c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+43:12449:x1874627728082304:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1787784682.205092:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784682.205120:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dc0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ce6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.205209:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dc12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.205228:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dc12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.205260:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dc12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787784682.205271:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1787784682.205517:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787784682.205521:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787784682.205611:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dc12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.205644:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dc0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ce6 expref: 45 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.205669:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dc12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ce6 expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.205679:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:3.0:1787784682.205682:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784682.205686:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712e00, rc 0) 00000100:00100000:3.0:1787784682.206213:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fa967c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+44:12449:x1874627728082304:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1154us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.206223:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 216 00000100:00100000:1.0:1787784682.216021:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784682.216100:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728082560 00000100:00100000:2.0:1787784682.216118:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728082560 00000100:00100000:2.0:1787784682.216200:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 217 00000100:00100000:2.0:1787784682.216213:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+44:12449:x1874627728082560:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784682.216242:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784682.216281:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dc19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ced expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.216439:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.216460:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.216475:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784682.216489:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787784682.216764:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dc19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ced expref: 47 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.216828:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ced expref: 46 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.216858:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:2.0:1787784682.216862:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784682.216867:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183000, rc 0) 00000100:00100000:2.0:1787784682.217187:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+46:12449:x1874627728082560:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 976us (1176us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1787784682.217196:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 217 00000100:00100000:0.0:1787784682.221937:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784682.222001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.222202:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728082816 00000100:00100000:3.0:1787784682.222215:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728082816 00000100:00100000:3.0:1787784682.222301:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 218 00000100:00100000:3.0:1787784682.222314:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4165e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+46:12449:x1874627728082816:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1787784682.222347:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784682.222373:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dc2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72cf4 expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.222531:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9dc35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.222734:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9dc35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.222749:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9dc35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784682.222764:0:14535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787784682.222929:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dc2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cf4 expref: 49 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784682.223213:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728082944 00000100:00100000:2.0:1787784682.223220:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728082944 00000100:00100000:2.0:1787784682.223295:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:2.0:1787784682.223306:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+49:2405:x1874627728082944:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784682.223319:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784682.223338:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ced expref: 49 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.223356:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:2.0:1787784682.223362:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784682.223435:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+48:2405:x1874627728082944:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 131us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784682.223445:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00010000:00010000:3.0:1787784682.223847:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9dc35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cf4 expref: 47 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.223858:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:3.0:1787784682.223861:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787784682.223864:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712400, rc 0) 00000100:00100000:3.0:1787784682.223896:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4165e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+47:12449:x1874627728082816:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1585us (1986us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1787784682.223904:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 218 00000100:00100000:1.0:1787784682.231423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784682.238930:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728083072 00000100:00100000:2.0:1787784682.238962:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728083072 00000100:00100000:2.0:1787784682.239071:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:2.0:1787784682.239088:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2406:x1874627728083072:12345-192.168.202.41@tcp:1:lfs.0 00010000:00010000:2.0:1787784682.239156:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.239490:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 8 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.239501:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784682.239506:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784682.239511:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.239637:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 8 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.239655:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 8 pid: 8916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784682.239673:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1874627750157952:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784682.240108:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c343b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784682.246082:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1874627750157952:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784682.246128:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784682.247972:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784682.248208:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728083200 00000100:00100000:0.0:1787784682.248220:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728083200 00002000:00100000:0.0:1787784682.248296:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8951ff47a1c0 x1874627728083200/t0(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:563/0 lens 504/0 e 0 to 0 dl 1787784693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784682.248309:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8951ff47a1c0 with x1874627728083200 ext(0->8) 00010000:00010000:0.0:1787784682.248322:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 9 pid: 8916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.248472:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 9 pid: 8916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784682.248481:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8951ff47a1c0 00000100:00100000:0.0:1787784682.248520:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:0.0:1787784682.248532:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2405:x1874627728083200:12345-192.168.202.41@tcp:4:lfs.0 00000100:00100000:0.0:1787784682.251697:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+11:2405:x1874627728083200:12345-192.168.202.41@tcp:4:lfs.0 Request processed in 3149us (3719us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787784682.251715:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00002000:00100000:0.0:1787784682.251731:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8951ff47a1c0 x1874627728083200/t4294967309(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:563/0 lens 504/448 e 0 to 0 dl 1787784693 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784682.251743:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8951ff47a1c0 with x1874627728083200 ext(0->8) 00010000:00010000:0.0:1787784682.252554:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 11 pid: 8916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.252580:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 11 pid: 8916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784682.252624:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8951ff47a1c0 00000100:00100000:1.0:1787784682.255850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.256081:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728083328 00000100:00100000:3.0:1787784682.256093:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728083328 00010000:00010000:3.0:1787784682.256144:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 11 pid: 8916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784682.256186:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 101 00000100:00100000:3.0:1787784682.256215:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff479e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+11:2406:x1874627728083328:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784682.256235:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787784682.256257:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787784682.256260:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787784681 00002000:00010000:3.0:1787784682.256263:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787784682 00002000:00010000:3.0:1787784682.256348:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787784681 00002000:00010000:3.0:1787784682.256350:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787784682.256358:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 11 pid: 8916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.256377:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 11 pid: 8916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.256408:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dc04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cdf expref: 11 pid: 8916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.256431:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784682.256437:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784682.256444:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.256457:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.256498:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784682.256634:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.256645:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.256677:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.256685:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.256693:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.256700:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784682.256706:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.256715:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.256728:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.256736:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b06d1f40/0x88ace7295d9dc43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784682.257001:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff479e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+10:2406:x1874627728083328:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 787us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.257021:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 101 00000100:00100000:2.0:1787784682.261825:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2406:x1874627728083072:12345-192.168.202.41@tcp:1:lfs.0 Request processed in 22719us (30396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784682.261847:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:3.0:1787784682.268023:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784682.268170:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728083584 00000100:00100000:0.0:1787784682.268183:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728083584 00000100:00100000:0.0:1787784682.268259:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:0.0:1787784682.268277:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fa975450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+47:12449:x1874627728083584:12345-192.168.202.41@tcp:35:lfs.0 00000004:00010000:0.0:1787784682.268372:0:14224:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9dc35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cf4 expref: 47 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784682.268674:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787784682.268704:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1787784682.269124:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:0.0:1787784682.269177:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.269196:0:14224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dbef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd1 expref: 51 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.269207:0:14224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.269251:0:14224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dbef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd1 expref: 51 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.269268:0:14224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dbef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd1 expref: 51 pid: 14535 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784682.269299:0:14224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4164000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14224:1874627750158080:192.168.202.41@tcp:104: 00000100:00100000:0.0:1787784682.269437:0:14224:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32240 going to sleep for 11 seconds 00000100:00100000:0.0:1787784682.282343:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784682.282688:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728083712 00000100:00100000:2.0:1787784682.282701:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728083712 00010000:00010000:2.0:1787784682.282761:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dbef lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd1 expref: 52 pid: 14535 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784682.282852:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 102 00000100:00100000:2.0:1787784682.282864:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4166940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+52:2405:x1874627728083712:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784682.282883:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784682.282891:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dbef lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd1 expref: 52 pid: 14535 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.282908:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dbef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd1 expref: 52 pid: 14535 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.282958:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:2.0:1787784682.282964:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.282975:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.282984:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.283008:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784682.283082:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4166940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+52:2405:x1874627728083712:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 220us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784682.283092:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 102 00010000:00010000:1.0:1787784682.289793:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dbef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cd1 expref: 51 pid: 14535 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784682.289829:0:14224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4164000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14224:1874627750158080:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784682.289867:0:14224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.289904:0:14224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.289924:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784682.290081:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:1.0:1787784682.290219:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1787784682.290340:0:14224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14224:1874627750158208:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787784682.290424:0:14224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784682.290479:0:14224:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784682.290813:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750158208 00000100:00100000:3.0:1787784682.290822:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750158208 00000100:00100000:3.0:1787784682.290909:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787784682.290931:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14224:x1874627750158208:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787784682.291049:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14224:x1874627750158208:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 118us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.291057:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:0.0:1787784682.291182:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784682.292802:0:14224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14224:1874627750158208:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1787784682.293010:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1787784682.293104:0:14224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14224:1874627750158336:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787784682.293180:0:14224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784682.293219:0:14224:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784682.294101:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750158336 00000100:00100000:3.0:1787784682.294114:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750158336 00000100:00100000:3.0:1787784682.294187:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787784682.294200:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff479680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14224:x1874627750158336:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787784682.294424:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff479680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:14224:x1874627750158336:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 226us (1243us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787784682.294432:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787784682.295879:0:14224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14224:1874627750158336:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1787784682.295994:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1787784682.296066:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.296080:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.296088:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.296095:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784682.296118:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.296127:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.296147:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:1.0:1787784682.296150:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787784682.296156:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.296163:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dc4a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787784682.296337:0:14224:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787784682.296421:0:14224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1787784682.296437:0:14224:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 422545667848ns, next at 423545665063ns, rc = 0 00000001:00080000:1.0:1787784682.296444:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1787784682.296470:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:1.0:1787784682.296474:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787784682.296482:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9dc35 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cf4 expref: 55 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784682.296815:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fa975450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+54:12449:x1874627728083584:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 28538us (28804us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787784682.296827:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000020:00080000:1.0:1787784682.296835:0:14224:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787784682.307979:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784682.308095:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728083840 00000100:00100000:1.0:1787784682.308109:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728083840 00000100:00100000:1.0:1787784682.308191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 219 00000100:00100000:1.0:1787784682.308204:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+54:12449:x1874627728083840:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787784682.308256:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784682.308307:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dc51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72cfb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.308394:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dc51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cfb expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.308413:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dc51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cfb expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.308438:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:1.0:1787784682.308442:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784682.308447:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602800, rc 0) 00000100:00100000:1.0:1787784682.308545:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+55:12449:x1874627728083840:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 335us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784682.308553:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 219 00000100:00100000:3.0:1787784682.315074:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784682.315207:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728084096 00000100:00100000:1.0:1787784682.315222:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728084096 00000100:00100000:1.0:1787784682.315307:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:1.0:1787784682.315318:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff456940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+55:12449:x1874627728084096:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1787784682.315650:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff456940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+56:12449:x1874627728084096:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 333us (590us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787784682.315659:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:3.0:1787784682.472103:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784682.472959:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728084224 00000100:00100000:1.0:1787784682.472975:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728084224 00000100:00100000:1.0:1787784682.473065:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 220 00000100:00100000:1.0:1787784682.473077:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff457c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+56:12459:x1874627728084224:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:1.0:1787784682.473213:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dc58 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473238:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dc58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473253:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dc58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473267:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9dc5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473276:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9dc5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473293:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9dc5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473526:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9dc66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473536:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9dc66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473543:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9dc66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784682.473602:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9dc66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473617:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dc58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473635:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dc58 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473642:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dc58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473649:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784682.473653:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dc58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473662:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dc58 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473675:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:1.0:1787784682.473678:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784682.473683:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dc58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473690:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dc58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473707:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9dc5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473713:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9dc5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473718:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9dc5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473723:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784682.473731:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9dc5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473737:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9dc5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473745:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67500) 00010000:00010000:1.0:1787784682.473748:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784682.473750:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9dc5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473756:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9dc5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.473765:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9dc66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.474016:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9dc66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.474023:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9dc66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.474028:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784682.474032:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9dc66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.474038:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9dc66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.474047:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:1.0:1787784682.474049:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784682.474059:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9dc66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.474065:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9dc66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784682.474177:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff457c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+56:12459:x1874627728084224:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 1099us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784682.474187:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 220 00000100:00100000:0.0:1787784682.576580:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.576680:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728084480 00000100:00100000:3.0:1787784682.576691:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728084480 00000100:00100000:3.0:1787784682.576753:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 221 00000100:00100000:3.0:1787784682.576763:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c41670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+56:12462:x1874627728084480:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1787784682.576808:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784682.576828:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dc6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d02 expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.576917:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dc74 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.576932:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dc74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577045:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dc74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577058:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dc7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577066:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dc7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577073:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dc7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577390:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9dc82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577399:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9dc82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577405:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9dc82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784682.577414:0:14535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787784682.577491:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dc74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577498:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dc74 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577511:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dc74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577518:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784682.577521:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dc74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577530:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dc74 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577543:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:3.0:1787784682.577546:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784682.577550:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dc74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577557:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dc74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577572:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dc7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577578:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dc7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577583:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dc7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577588:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784682.577591:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dc7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577606:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dc7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577615:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67500) 00010000:00010000:3.0:1787784682.577617:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784682.577620:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dc7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577626:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dc7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577664:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dc6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d02 expref: 59 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577678:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9dc82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d02 expref: 58 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.577685:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:3.0:1787784682.577687:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784682.577690:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713800, rc 0) 00000100:00100000:3.0:1787784682.577850:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c41670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+58:12462:x1874627728084480:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1087us (1279us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1787784682.577858:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 221 00000100:00100000:3.0:1787784682.585219:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784682.585650:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728084608 00000100:00100000:2.0:1787784682.585677:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728084608 00000100:00100000:2.0:1787784682.585742:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 222 00000100:00100000:2.0:1787784682.585753:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+58:12462:x1874627728084608:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:2.0:1787784682.585839:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.585857:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.585870:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.585904:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.585911:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.585918:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.585925:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784682.585929:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.585945:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.585959:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:2.0:1787784682.585962:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784682.585967:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.585983:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784682.586060:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+58:12462:x1874627728084608:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 308us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784682.586068:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 222 00000100:00100000:0.0:1787784682.589635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784682.589811:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728084864 00000100:00100000:1.0:1787784682.589822:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728084864 00000100:00100000:1.0:1787784682.589888:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:1.0:1787784682.589899:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c41661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+58:12462:x1874627728084864:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1787784682.590932:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c41661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+59:12462:x1874627728084864:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 1030us (1301us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787784682.591661:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:1.0:1787784682.717971:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784682.718189:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728085120 00000100:00100000:2.0:1787784682.718200:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728085120 00000100:00100000:2.0:1787784682.718257:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 223 00000100:00100000:2.0:1787784682.718269:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+59:12472:x1874627728085120:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787784682.718303:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784682.718306:0:7991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787784682.718334:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712e00/0x88ace7295d9dc12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ce6 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.718356:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784682.718361:0:7991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784682.718373:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc97 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d09 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.718479:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dc9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.718494:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dc9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.718505:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dc9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784682.718533:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787784682.718651:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9dc97 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d09 expref: 61 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.718664:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dc9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d09 expref: 60 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.718671:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:2.0:1787784682.718673:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784682.718676:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183c00, rc 0) 00000100:00100000:2.0:1787784682.718752:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+60:12472:x1874627728085120:12345-192.168.202.41@tcp:101:bash.0 Request processed in 486us (794us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787784682.718760:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 223 00000100:00100000:3.0:1787784682.733986:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.734042:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784682.734211:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728085248 00000100:00100000:2.0:1787784682.734221:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728085248 00000100:00100000:2.0:1787784682.734301:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:2.0:1787784682.734310:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+60:2407:x1874627728085248:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784682.734327:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784682.734352:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dc9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d09 expref: 60 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.734370:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:2.0:1787784682.734375:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784682.734435:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+59:2407:x1874627728085248:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 125us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784682.734442:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:0.0:1787784682.734924:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728085376 00000100:00100000:0.0:1787784682.734930:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728085376 00000100:00100000:0.0:1787784682.734985:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 224 00000100:00100000:0.0:1787784682.734993:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff455e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+59:12472:x1874627728085376:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1787784682.735014:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784682.735032:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dcac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d10 expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.735065:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9dcb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.735078:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9dcb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.735088:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9dcb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.735207:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dcac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d10 expref: 61 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.735224:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9dcb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d10 expref: 60 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.735243:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:0.0:1787784682.735247:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787784682.735250:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628400, rc 0) 00000100:00100000:0.0:1787784682.735305:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff455e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+60:12472:x1874627728085376:12345-192.168.202.41@tcp:101:bash.0 Request processed in 312us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784682.735313:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 224 00000100:00100000:3.0:1787784682.751147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784682.751264:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728085632 00000100:00100000:2.0:1787784682.751274:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728085632 00000100:00100000:2.0:1787784682.751346:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 225 00000100:00100000:2.0:1787784682.751356:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff455680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+60:12472:x1874627728085632:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:2.0:1787784682.751411:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784682.751437:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713800/0x88ace7295d9dc82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d02 expref: 60 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.751459:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:2.0:1787784682.751464:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784682.751623:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dcba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.751637:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dcba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.751647:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dcba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784682.751690:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:2.0:1787784682.751714:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084624c33 reply state 000000000055d7de transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dcba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.751726:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dcba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.751732:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:2.0:1787784682.751735:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787784682.751737:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784682.751888:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff455680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+62:12472:x1874627728085632:12345-192.168.202.41@tcp:36:bash.0 Request processed in 533us (749us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1787784682.751913:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 225 00000020:00080000:2.0:1787784682.751918:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787784682.763483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784682.763638:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728085760 00000100:00100000:0.0:1787784682.763650:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728085760 00000100:00100000:0.0:1787784682.763719:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 226 00000100:00100000:0.0:1787784682.763730:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+62:12472:x1874627728085760:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1787784682.763754:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784682.763821:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dcc1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d17 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.763925:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9dcc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.764127:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9dcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784682.764143:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9dcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784682.764369:0:7991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787784682.764375:0:7991:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787784682.764398:0:7991:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9dcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.764427:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dcc1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d17 expref: 64 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.764447:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9dcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d17 expref: 63 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.764455:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:1.0:1787784682.764472:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784682.764476:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629400, rc 0) 00000100:00100000:1.0:1787784682.764543:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+63:12472:x1874627728085760:12345-192.168.202.41@tcp:101:bash.0 Request processed in 814us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784682.764551:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 226 00000100:00100000:1.0:1787784682.774702:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784682.774912:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728086016 00000100:00100000:2.0:1787784682.774923:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728086016 00000100:00100000:2.0:1787784682.775002:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:2.0:1787784682.775011:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+63:12472:x1874627728086016:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:2.0:1787784682.775245:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+64:12472:x1874627728086016:12345-192.168.202.41@tcp:35:bash.0 Request processed in 234us (551us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787784682.775252:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:3.0:1787784682.783597:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784682.783726:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728086144 00000100:00100000:2.0:1787784682.783737:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728086144 00000100:00100000:2.0:1787784682.783831:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 426 00000100:00100000:2.0:1787784682.783842:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2407:x1874627728086144:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784682.783927:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2407:x1874627728086144:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 88us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784682.783935:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 426 00000100:00100000:0.0:1787784682.790404:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.791956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.791996:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.792029:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.792065:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728086272 00000100:00100000:3.0:1787784682.792074:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728086272 00000100:00080000:3.0:1787784682.792104:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784682.792158:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728086784 00000100:00100000:3.0:1787784682.792161:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728086784 00000100:00080000:3.0:1787784682.792175:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784682.792200:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 359 00000100:00100000:3.0:1787784682.792210:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728086272:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784682.792279:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728086272:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 70us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.792297:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 359 00000100:00100000:3.0:1787784682.792316:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 360 00000100:00100000:3.0:1787784682.792322:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff456d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728086784:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784682.792347:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff456d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728086784:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.792353:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 360 00000100:00100000:2.0:1787784682.792764:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728086400 00000100:00100000:2.0:1787784682.792808:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728086400 00000100:00100000:2.0:1787784682.792852:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728086528 00000100:00100000:2.0:1787784682.792856:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728086528 00000100:00100000:2.0:1787784682.792879:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 108 00000100:00100000:2.0:1787784682.792888:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2407:x1874627728086400:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784682.792925:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2407:x1874627728086400:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 40us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784682.792958:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 108 00000100:00100000:2.0:1787784682.792973:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 109 00000100:00100000:2.0:1787784682.792979:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2408:x1874627728086528:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784682.793004:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2408:x1874627728086528:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784682.793010:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 109 00000100:00080000:3.0:1787784682.793719:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784682.794371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784682.794451:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728086656 00000100:00100000:1.0:1787784682.794459:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728086656 00000100:00100000:1.0:1787784682.794517:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 361 00000100:00100000:1.0:1787784682.794526:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff457840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728086656:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784682.794594:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff457840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728086656:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 70us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784682.794602:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 361 00000100:00080000:3.0:1787784682.794898:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787784682.823004:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787784682.881261:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.881442:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728086912 00000100:00100000:3.0:1787784682.881452:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728086912 00000100:00100000:3.0:1787784682.881516:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 227 00000100:00100000:3.0:1787784682.881527:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4165680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+64:12478:x1874627728086912:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1787784682.881552:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784682.881590:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dccf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d1e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.881661:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dcd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.881676:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dcd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.881687:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dcd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784682.881733:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787784682.881737:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787784682.881757:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dcd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.884341:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dccf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d1e expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.884375:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dcd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d1e expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.884385:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:3.0:1787784682.884388:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784682.884391:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713600, rc 0) 00000100:00100000:3.0:1787784682.884489:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4165680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+65:12478:x1874627728086912:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 2963us (3240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.884498:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 227 00000100:00100000:0.0:1787784682.891142:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.891384:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728087040 00000100:00100000:3.0:1787784682.891424:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728087040 00000100:00100000:3.0:1787784682.891487:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 228 00000100:00100000:3.0:1787784682.891496:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+65:12478:x1874627728087040:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1787784682.891517:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784682.891538:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dcdd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d25 expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.891600:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dce4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.891613:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dce4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.891624:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dce4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.891633:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dceb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.891639:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.891645:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.891714:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dcf2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.891722:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.891728:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784682.892405:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787784682.892411:0:11332:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787784682.892439:0:11332:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892454:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892463:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dce4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892469:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dce4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892475:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dce4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892481:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784682.892485:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dce4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892492:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dce4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892504:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:3.0:1787784682.892507:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784682.892511:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dce4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892517:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dce4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892544:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892550:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dceb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892555:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dceb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892560:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784682.892562:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dceb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892568:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dceb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892576:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67500) 00010000:00010000:3.0:1787784682.892578:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784682.892581:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dceb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892586:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dceb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892611:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dcdd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d25 expref: 67 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892622:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dcf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d25 expref: 66 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.892637:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:3.0:1787784682.892639:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784682.892641:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712600, rc 0) 00000100:00100000:3.0:1787784682.892698:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+66:12478:x1874627728087040:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1204us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.892706:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 228 00000100:00100000:1.0:1787784682.899370:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784682.899489:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.899573:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728087424 00000100:00100000:3.0:1787784682.899583:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728087424 00000100:00100000:3.0:1787784682.899698:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:3.0:1787784682.899708:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+66:2405:x1874627728087424:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784682.899724:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784682.899750:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dcf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d25 expref: 66 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.899820:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:3.0:1787784682.899827:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784682.899881:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+65:2405:x1874627728087424:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 174us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.899889:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:2.0:1787784682.900748:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728087296 00000100:00100000:2.0:1787784682.900755:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728087296 00000100:00100000:2.0:1787784682.900839:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 229 00000100:00100000:2.0:1787784682.900847:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff479a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+65:12478:x1874627728087296:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784682.900863:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784682.900881:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9dcf9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d2c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.900990:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.901005:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9dcc8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d17 expref: 66 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.901014:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.901233:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9dcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d17 expref: 66 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.901264:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9dcc8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d17 expref: 66 pid: 7991 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784682.901292:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874627750158464:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784682.901382:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c343bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784682.907895:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874627750158464:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784682.907930:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784682.913539:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784682.914467:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728087552 00000100:00100000:2.0:1787784682.914477:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728087552 00010000:00010000:2.0:1787784682.914522:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9dcc8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d17 expref: 67 pid: 7991 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784682.914563:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 103 00000100:00100000:2.0:1787784682.914574:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+67:2407:x1874627728087552:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784682.914590:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784682.914597:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9dcc8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d17 expref: 67 pid: 7991 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.914611:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9dcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d17 expref: 67 pid: 7991 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.914636:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9dcc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d17 expref: 67 pid: 7991 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.914680:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:2.0:1787784682.914685:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.914695:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.914704:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784682.914743:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784682.914847:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+66:2407:x1874627728087552:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 275us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784682.914857:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 103 00010000:00010000:1.0:1787784682.914933:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.914942:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784682.914961:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787784682.915100:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9dcf9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d2c expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.915116:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d2c expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.915148:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:1.0:1787784682.915151:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787784682.915153:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4182a00, rc 0) 00000100:00100000:1.0:1787784682.915194:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff479a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+66:12478:x1874627728087296:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 14347us (15834us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787784682.915202:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 229 00000100:00100000:1.0:1787784682.918910:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.918984:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728087808 00000100:00100000:3.0:1787784682.918994:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728087808 00000100:00100000:3.0:1787784682.919051:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:3.0:1787784682.919061:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+66:12478:x1874627728087808:12345-192.168.202.41@tcp:103:lfs.0 00010000:00010000:3.0:1787784682.919089:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784682.919118:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9dc51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cfb expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.919150:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:3.0:1787784682.919168:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784682.919239:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+65:12478:x1874627728087808:12345-192.168.202.41@tcp:103:lfs.0 Request processed in 180us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.919247:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:3.0:1787784682.922034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784682.922078:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728087936 00000100:00100000:1.0:1787784682.922089:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728087936 00000100:00100000:1.0:1787784682.922270:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 230 00000100:00100000:1.0:1787784682.922343:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+65:12478:x1874627728087936:12345-192.168.202.41@tcp:58:lfs.0 00010000:00010000:1.0:1787784682.922493:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dd0e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.922513:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dd0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784682.922525:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dd0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787784682.922624:0:14535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787784682.922706:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+65:12478:x1874627728087936:12345-192.168.202.41@tcp:58:lfs.0 Request processed in 426us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784682.922713:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 230 00000100:00100000:1.0:1787784682.933945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784682.934237:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728088064 00000100:00100000:3.0:1787784682.934248:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728088064 00000100:00100000:3.0:1787784682.934424:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 231 00000100:00100000:3.0:1787784682.934435:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+65:12478:x1874627728088064:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1787784682.934456:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784682.934477:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dd15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d33 expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.934531:0:11332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dd0e lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.934544:0:11332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dd15 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d33 expref: 66 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.934562:0:11332:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dd0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.934576:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dd15 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d33 expref: 66 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.934590:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:3.0:1787784682.934606:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787784682.934610:0:11332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dd15 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d33 expref: 66 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784682.934619:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713c00, rc 0) 00000100:00100000:3.0:1787784682.934688:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+66:12478:x1874627728088064:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 255us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.934696:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 231 00010000:00010000:1.0:1787784683.015394:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787784683.592226:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784683.592235:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784683.592264:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787784683.592272:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784683.592430:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1874627750158592:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787784683.594181:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784683.596952:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff456580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1874627750158592:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787784683.607457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784683.610735:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728088192 00000100:00100000:2.0:1787784683.610750:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728088192 00000100:00100000:2.0:1787784683.610864:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 232 00000100:00100000:2.0:1787784683.610876:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+66:12479:x1874627728088192:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787784683.610912:0:7991:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787784683.611056:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+66:12479:x1874627728088192:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 181us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784683.611065:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 232 00000100:00100000:1.0:1787784683.624272:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784683.624377:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728088320 00000100:00100000:3.0:1787784683.624390:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728088320 00000100:00100000:3.0:1787784683.624459:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 233 00000100:00100000:3.0:1787784683.624469:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+66:12479:x1874627728088320:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787784683.624557:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dd1c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624574:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dd1c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624587:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dd1c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624622:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd23 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624629:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd23 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624636:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd23 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624659:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dd2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624669:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dd2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624675:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dd2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784683.624723:0:14535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787784683.624728:0:14535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787784683.624741:0:14535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dd2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624752:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dd1c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624758:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dd1c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624765:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dd1c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624818:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784683.624823:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dd1c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624830:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dd1c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624843:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951f5128c00) 00010000:00010000:3.0:1787784683.624846:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784683.624851:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dd1c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624857:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9dd1c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624872:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd23 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624877:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd23 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624883:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd23 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624888:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784683.624891:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd23 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624897:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd23 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624915:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8951f5138000) 00010000:00010000:3.0:1787784683.624919:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784683.624922:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd23 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624927:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd23 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624961:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dd2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624967:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dd2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624972:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dd2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624977:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784683.624980:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dd2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624985:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dd2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.624991:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:3.0:1787784683.624994:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784683.624996:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dd2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.625001:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dd2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784683.625090:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+66:12479:x1874627728088320:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 Request processed in 622us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784683.625099:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 233 00000100:00100000:3.0:1787784683.634606:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784683.634680:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728088576 00000100:00100000:0.0:1787784683.634702:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728088576 00000100:00100000:0.0:1787784683.634817:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 234 00000100:00100000:0.0:1787784683.634828:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff456580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+66:12479:x1874627728088576:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784683.634853:0:11332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784683.634877:0:11332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dd31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d3a expref: -99 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.635011:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.635028:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.635040:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784683.635052:0:11332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787784683.635137:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.635145:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.635462:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.635471:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784683.635478:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.635487:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.635575:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:0.0:1787784683.635578:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787784683.635583:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.635590:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.635637:0:11332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dd31 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d3a expref: 68 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.635648:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951f5128c00) 00010000:00010000:0.0:1787784683.635651:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784683.635654:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dd31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d3a expref: 68 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.635663:0:11332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629200, rc 0) 00000100:00100000:0.0:1787784683.635736:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff456580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+67:12479:x1874627728088576:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 909us (1139us total) trans 4294967506 rc 301/301 00000100:00100000:0.0:1787784683.635743:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 234 00000100:00100000:2.0:1787784683.639712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784683.639823:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728088704 00000100:00100000:1.0:1787784683.639832:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728088704 00000100:00100000:1.0:1787784683.639893:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 235 00000100:00100000:1.0:1787784683.639903:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+67:12479:x1874627728088704:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787784683.639939:0:7991:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787784683.640052:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+67:12479:x1874627728088704:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 149us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784683.640060:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 235 00000100:00100000:1.0:1787784683.652624:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784683.653108:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728088960 00000100:00100000:3.0:1787784683.653118:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728088960 00000100:00100000:3.0:1787784683.653178:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 236 00000100:00100000:3.0:1787784683.653188:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+67:12479:x1874627728088960:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784683.653216:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784683.653219:0:14535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787784683.653246:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9dcd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d1e expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.653266:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:3.0:1787784683.653271:0:14535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784683.653295:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dd46 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d41 expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787784683.653697:0:14535:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:3.0:1787784683.653868:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.653881:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.653890:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.653952:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712a00/0x88ace7295d9dd46 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d41 expref: 69 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.653966:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d41 expref: 68 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.653973:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8951f5138000) 00010000:00010000:3.0:1787784683.653976:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784683.653978:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712000, rc 0) 00000100:00100000:3.0:1787784683.654029:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+68:12479:x1874627728088960:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 843us (1416us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787784683.654036:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 236 00000100:00100000:2.0:1787784683.654471:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750158720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784683.655662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787784683.655824:0:8915:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 423905054331ns, next at 424905040491ns, rc = 0 00000100:00100000:0.0:1787784683.655849:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750158848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784683.655885:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784683.655915:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750158720 00000100:00100000:2.0:1787784683.655943:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750158720 00000100:00100000:1.0:1787784683.655988:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750158848 00000100:00100000:1.0:1787784683.655994:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750158848 00000100:00100000:2.0:1787784683.656012:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787784683.656026:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750158720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784683.656048:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42323648 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1787784683.656094:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750158720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (437us total) trans 0 rc 0/0 00000100:00080000:0.0:1787784683.656138:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784683.656180:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784683.656188:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4167c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750158976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784683.656228:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784683.656323:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750158720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784683.657348:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750158976 00000100:00100000:3.0:1787784683.657358:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750158976 00000100:00100000:3.0:1787784683.657403:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787784683.657414:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750158976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787784683.657448:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787784683.657592:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750158976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 179us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784683.657600:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787784683.657647:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4167c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750158976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784683.661357:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787784683.661380:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4166d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750158848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784683.661412:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42323648 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1787784683.661520:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4166d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750158848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (5634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784683.661528:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787784683.661684:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:3.0:1787784683.661691:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:3.0:1787784683.661723:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750158848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784683.663332:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000001:00080000:0.0:1787784683.663660:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1787784683.663669:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1787784683.665486:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784683.670932:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728089216 00000100:00100000:0.0:1787784683.670946:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728089216 00000100:00100000:0.0:1787784683.671020:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 237 00000100:00100000:0.0:1787784683.671029:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+68:12479:x1874627728089216:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787784683.671083:0:11332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784683.671108:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9dd4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d41 expref: 68 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671129:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8951f5138000) 00010000:00010000:0.0:1787784683.671143:0:11332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784683.671162:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dd5b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671176:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dd5b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671185:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dd5b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671343:0:11332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x94047dc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671352:0:11332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x94047dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671360:0:11332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x94047dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671429:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dd5b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671436:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dd5b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671444:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dd5b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671449:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784683.671453:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dd5b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671461:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dd5b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671469:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:0.0:1787784683.671472:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784683.671475:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dd5b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671481:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9dd5b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.671491:0:11332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x94047dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.672946:0:11332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd62 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x94047dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.672954:0:11332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd62 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x94047dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.672980:0:11332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784683.672984:0:11332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd62 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x94047dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.672993:0:11332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd62 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x94047dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.673009:0:11332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x94047dc6 (ffff8950c23c7400) 00010000:00010000:0.0:1787784683.673011:0:11332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784683.673015:0:11332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd62 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x94047dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.673022:0:11332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9dd62 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x94047dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784683.673161:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+67:12479:x1874627728089216:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 2129us (7683us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787784683.673170:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 237 00000100:00100000:2.0:1787784683.676639:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784683.681682:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728089344 00000100:00100000:1.0:1787784683.681698:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728089344 00000100:00100000:1.0:1787784683.681899:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 238 00000100:00100000:1.0:1787784683.681911:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+67:12479:x1874627728089344:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784683.681933:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784683.681956:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9dd69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d48 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.681991:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9dd70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.682023:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9dd70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.682035:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9dd70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.682144:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9dd69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d48 expref: 69 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.682164:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9dd70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d48 expref: 68 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.682173:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:1.0:1787784683.682175:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787784683.682178:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602000, rc 0) 00000100:00100000:1.0:1787784683.682253:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+68:12479:x1874627728089344:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 344us (5624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784683.682260:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 238 00000100:00100000:3.0:1787784683.687404:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784683.697997:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728089600 00000100:00100000:2.0:1787784683.698015:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728089600 00000100:00100000:2.0:1787784683.698106:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 239 00000100:00100000:2.0:1787784683.698117:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+68:12479:x1874627728089600:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787784683.699622:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9dd77 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.699648:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9dd77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.699663:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9dd77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784683.699827:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:2.0:1787784683.699878:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000387eaa1 reply state 0000000057794874 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9dd77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.699891:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9dd77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.699898:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:2.0:1787784683.699901:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787784683.699918:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784683.700026:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+70:12479:x1874627728089600:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 1908us (12629us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1787784683.700035:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 239 00000100:00100000:3.0:1787784683.707069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784683.707145:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728089728 00000100:00100000:2.0:1787784683.707157:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728089728 00000100:00100000:2.0:1787784683.707343:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 240 00000100:00100000:2.0:1787784683.707356:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+70:12479:x1874627728089728:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784683.707381:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784683.707403:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9dd7e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.707461:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9dd7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d4f expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.707476:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9dd7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d4f expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.707575:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:2.0:1787784683.707579:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784683.707583:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4182400, rc 0) 00000100:00100000:2.0:1787784683.707648:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+71:12479:x1874627728089728:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 296us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784683.707656:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 240 00000100:00100000:3.0:1787784683.712292:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784683.712613:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728089856 00000100:00100000:2.0:1787784683.712623:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728089856 00000100:00100000:2.0:1787784683.712689:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:2.0:1787784683.712699:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1196580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2407:x1874627728089856:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787784683.713053:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1196580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2407:x1874627728089856:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 355us (778us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787784683.713062:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:3.0:1787784683.715721:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784683.715850:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728090112 00000100:00100000:1.0:1787784683.715862:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728090112 00000100:00100000:1.0:1787784683.715922:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:1.0:1787784683.715931:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+71:12479:x1874627728090112:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787784683.716148:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+72:12479:x1874627728090112:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 218us (438us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1787784683.716156:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:1.0:1787784683.719498:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784683.719592:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728090368 00000100:00100000:3.0:1787784683.719602:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728090368 00000100:00100000:3.0:1787784683.719664:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 241 00000100:00100000:3.0:1787784683.719674:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+72:12479:x1874627728090368:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787784683.719816:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+72:12479:x1874627728090368:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 143us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784683.719824:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 241 00000100:00100000:3.0:1787784683.726099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784683.726269:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728090496 00000100:00100000:1.0:1787784683.726319:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728090496 00000100:00100000:1.0:1787784683.726395:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 242 00000100:00100000:1.0:1787784683.726406:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+72:12479:x1874627728090496:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784683.726427:0:7991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784683.726448:0:7991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9dd85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d56 expref: -99 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.726517:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9dd8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.726533:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9dd8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.726545:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9dd8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784683.726594:0:7991:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787784683.726614:0:7991:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9dd8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.726642:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9dd85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d56 expref: 74 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.726659:0:7991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9dd8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d56 expref: 73 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.726668:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:1.0:1787784683.726671:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787784683.726674:0:7991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602e00, rc 0) 00000100:00100000:1.0:1787784683.726763:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+73:12479:x1874627728090496:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 358us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784683.726823:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 242 00000100:00100000:0.0:1787784683.731699:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784683.731748:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728090624 00000100:00100000:3.0:1787784683.731758:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728090624 00000100:00100000:3.0:1787784683.731910:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:3.0:1787784683.731921:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2406:x1874627728090624:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784683.732008:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784683.732030:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9dd93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d5d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784683.732056:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6deb, blocks: 0x0 00010000:00010000:3.0:1787784683.732078:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1787784683.732082:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784683.732092:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9dd93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d5d expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.732110:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9dd93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d5d expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.732139:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712a00, rc 0) 00000100:00100000:3.0:1787784683.732643:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2406:x1874627728090624:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 722us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784683.732651:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:2.0:1787784683.741705:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784683.741812:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728090880 00000100:00100000:0.0:1787784683.741823:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728090880 00000100:00100000:0.0:1787784683.741888:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 243 00000100:00100000:0.0:1787784683.741898:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+73:12479:x1874627728090880:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787784683.742015:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+73:12479:x1874627728090880:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 118us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784683.742023:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 243 00000100:00100000:0.0:1787784683.746879:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784683.746954:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728091008 00000100:00100000:2.0:1787784683.747008:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728091008 00000100:00100000:2.0:1787784683.747109:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:2.0:1787784683.747121:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4167c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+9:12479:x1874627728091008:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784683.747139:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784683.747157:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026b2fa41/0x88ace7295d9dd9a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d64 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.747198:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9dd93 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d5d expref: 10 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.747208:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784683.747212:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784683.747217:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026b2fa41/0x88ace7295d9dd9a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d64 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.747249:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9dd93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d5d expref: 10 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.747263:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9dd93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d5d expref: 10 pid: 8438 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784683.747302:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1874627750159104:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784683.747399:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c343bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784683.754648:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784683.754841:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1874627750159104:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784683.754877:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026b2fa41/0x88ace7295d9dd9a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d64 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.754898:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4182e00, rc 0) 00000100:00100000:3.0:1787784683.754953:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4167c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+10:12479:x1874627728091008:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 7835us (8081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784683.754973:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:0.0:1787784683.755181:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728091136 00000100:00100000:0.0:1787784683.755188:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728091136 00010000:00010000:0.0:1787784683.755231:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9dd93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d5d expref: 10 pid: 8438 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784683.755267:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 104 00000100:00100000:0.0:1787784683.755286:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+10:2405:x1874627728091136:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784683.755301:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784683.755324:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9dd93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d5d expref: 10 pid: 8438 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.755336:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9dd93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d5d expref: 10 pid: 8438 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.755364:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9dd93 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d5d expref: 10 pid: 8438 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.755377:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787784683.755382:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784683.755389:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000026b2fa41/0x88ace7295d9dd9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d64 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.755398:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026b2fa41/0x88ace7295d9dd9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d64 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.755427:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000026b2fa41/0x88ace7295d9dd9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d64 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784683.755453:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3576580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1874627750159232:192.168.202.41@tcp:105: 00000100:00100000:0.0:1787784683.755503:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784683.761206:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3576580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1874627750159232:192.168.202.41@tcp:105: 00010000:00010000:0.0:1787784683.761239:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784683.761318:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2405:x1874627728091136:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 6041us (6679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784683.761330:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 104 00000100:00100000:0.0:1787784683.762613:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784683.762855:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728091264 00000100:00100000:3.0:1787784683.762863:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728091264 00002000:00100000:3.0:1787784683.762912:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8950c3576580 x1874627728091264/t0(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:564/0 lens 504/0 e 0 to 0 dl 1787784694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787784683.762922:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c3576580 with x1874627728091264 ext(0->12) 00002000:00010000:3.0:1787784683.762940:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c3576580 00000100:00100000:3.0:1787784683.762977:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:3.0:1787784683.762987:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3576580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2406:x1874627728091264:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787784683.767331:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3576580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+11:2406:x1874627728091264:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 Request processed in 4333us (4713us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787784683.767346:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00002000:00100000:3.0:1787784683.767375:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8950c3576580 x1874627728091264/t4294967322(0) o4->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:564/0 lens 504/448 e 0 to 0 dl 1787784694 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787784683.767385:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c3576580 with x1874627728091264 ext(0->12) 00002000:00010000:3.0:1787784683.767391:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c3576580 00000100:00100000:2.0:1787784683.783461:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784683.783571:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728091392 00000100:00100000:3.0:1787784683.783581:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728091392 00000100:00100000:3.0:1787784683.783649:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 244 00000100:00100000:3.0:1787784683.783660:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+73:12479:x1874627728091392:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787784683.786739:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:0.0:1787784683.786758:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00010000:00010000:3.0:1787784683.786872:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9da9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.786885:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9da9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.786893:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9da9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.786900:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784683.786905:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9da9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.786913:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9da9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.786943:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8951f511ed00) 00010000:00010000:3.0:1787784683.786946:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784683.786951:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9da9f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.786958:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182200/0x88ace7295d9da9f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787002:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9db47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787009:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9db47 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787014:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9db47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787019:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784683.787022:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9db47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787028:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9db47 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787037:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8950c26a3600) 00010000:00010000:3.0:1787784683.787039:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784683.787042:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9db47 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787047:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9db47 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787073:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dbc5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787081:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dbc5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787087:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dbc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787098:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784683.787102:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dbc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787107:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dbc5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787116:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67500) 00010000:00010000:3.0:1787784683.787119:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784683.787122:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dbc5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787128:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183800/0x88ace7295d9dbc5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787141:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dbe8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787157:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dbe8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787163:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dbe8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787168:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784683.787171:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dbe8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787177:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dbe8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787204:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951e0a67500) 00010000:00010000:3.0:1787784683.787207:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784683.787211:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dbe8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787217:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9dbe8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787234:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dcba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787240:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dcba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787246:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dcba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787251:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784683.787254:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dcba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787260:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dcba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787267:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:3.0:1787784683.787269:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784683.787281:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dcba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787288:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9dcba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787309:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9dd77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787316:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9dd77 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787322:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9dd77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787327:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784683.787330:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9dd77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787336:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9dd77 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787344:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:3.0:1787784683.787347:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787784683.787350:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9dd77 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.787356:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182600/0x88ace7295d9dd77 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787784683.787496:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787784683.787522:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8950c33783c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787784683.787526:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8951d2450d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8950c3378840 00000020:00080000:0.0:1787784683.787529:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8951d2450b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8950c3369400 00000004:00080000:0.0:1787784683.787561:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1787784683.787588:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787784683.787693:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784683.787711:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750159360:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787784683.787792:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784683.787842:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750159360 00000100:00100000:1.0:1787784683.787849:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750159360 00000100:00100000:1.0:1787784683.787892:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787784683.787901:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750159360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787784683.787930:0:8916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1787784683.787974:0:8916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f6de9, atime: 0x6a8f6dea, ctime: 0x6a8f6de9, blocks: 0x8 00010000:00010000:1.0:1787784683.787982:0:8916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dda1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.787998:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1787784683.788002:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784683.788009:0:8916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dda1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.788024:0:8916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dda1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.788034:0:8916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dda1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.788043:0:8916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dda1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.788067:0:8916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787784683.788221:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1874627750159360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 320us (428us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787784683.788230:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1787784683.788249:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784683.788256:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dda1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.788264:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784683.788269:0:10397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dda1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.788288:0:10397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dda1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.788303:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dda1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.788311:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005743a31f/0x88ace7295d9dda1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.788326:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784683.788328:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784683.788329:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784683.788355:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787784683.788361:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000004:00080000:1.0:1787784683.788386:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8950c36ca580, transno 4294967308 00000004:00080000:1.0:1787784683.788395:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:1.0:1787784683.788407:0:3645:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8950c36c8000 x1874627750159360/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787784699 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787784683.788418:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8950c36c8000/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787784683.788422:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750159360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787784683.790457:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00080000:0.0:1787784683.790648:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8950c3685480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787784683.790655:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8950c24bc100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8951c1370000 00000020:00080000:0.0:1787784683.790658:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8950c24bcd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8950c2365000 00000020:00080000:1.0:1787784683.790842:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787784683.790897:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787784683.792763:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12479:x1874627728091392:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 Request processed in 9096us (9302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784683.792793:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 244 00000100:00100000:3.0:1787784683.795913:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750159488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787784683.796002:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784683.796644:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784683.800188:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750159488 00000100:00100000:3.0:1787784683.800202:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750159488 00000100:00100000:3.0:1787784683.800301:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728091520 00000100:00100000:3.0:1787784683.800305:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728091520 00000100:00100000:3.0:1787784683.800347:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787784683.800357:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750159488:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787784683.800357:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:1.0:1787784683.800367:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+11:2405:x1874627728091520:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 00002000:00080000:3.0:1787784683.800389:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1787784683.800413:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.800434:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000050e03ed0/0x88ace7295d9db55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cbc expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.800442:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787784683.800446:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784683.800451:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.800488:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000050e03ed0/0x88ace7295d9db55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cbc expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.800515:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000050e03ed0/0x88ace7295d9db55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cbc expref: 11 pid: 8436 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784683.800528:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1874627750159616:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787784683.800608:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665b40 going to sleep for 11 seconds 00000001:00080000:1.0:1787784683.805486:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:2.0:1787784683.805688:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2405:x1874627728091520:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 Request processed in 5318us (9041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784683.805701:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:2.0:1787784683.806182:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784683.806208:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728091648 00000100:00100000:2.0:1787784683.806216:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728091648 00010000:00010000:2.0:1787784683.806254:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000050e03ed0/0x88ace7295d9db55 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cbc expref: 8 pid: 8436 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784683.806300:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 105 00000100:00100000:2.0:1787784683.806311:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2406:x1874627728091648:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784683.806325:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784683.806330:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000050e03ed0/0x88ace7295d9db55 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cbc expref: 8 pid: 8436 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.806343:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000050e03ed0/0x88ace7295d9db55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cbc expref: 8 pid: 8436 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.806382:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784683.806387:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784683.806393:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.806404:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.806425:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784683.806455:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2406:x1874627728091648:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 147us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784683.806463:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 105 00010000:00010000:3.0:1787784683.808674:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050e03ed0/0x88ace7295d9db55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72cbc expref: 7 pid: 8436 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784683.808715:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1874627750159616:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784683.808737:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.808748:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.808755:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.808766:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.808791:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.808808:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787784683.809002:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750159488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8645us (12998us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787784683.809012:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:3.0:1787784683.809058:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8950c43b0780/2, rc 0, transno 4294967323 00000100:00100000:3.0:1787784683.809071:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750159488:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787784683.810691:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784683.810702:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.810715:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784683.810720:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.810732:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.810753:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.810824:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005569c64/0x88ace7295d9dda8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.810848:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784683.810851:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784683.810852:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784683.817103:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784683.817254:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728091904 00000100:00100000:1.0:1787784683.817280:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728091904 00000100:00100000:1.0:1787784683.817347:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 245 00000100:00100000:1.0:1787784683.817358:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12479:x1874627728091904:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787784683.817414:0:7991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784683.817442:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9dd8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d56 expref: 21 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.817462:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:1.0:1787784683.817466:0:7991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784683.817507:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ddaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.817521:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ddaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.817530:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ddaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784683.817661:0:7991:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009de15aa reply state 000000007edb996c transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ddaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.817674:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ddaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.817679:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:1.0:1787784683.817681:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787784683.817684:0:7991:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784683.817821:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+22:12479:x1874627728091904:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 464us (730us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1787784683.817829:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 245 00000100:00100000:1.0:1787784683.824190:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784683.824348:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728092032 00000100:00100000:0.0:1787784683.824360:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728092032 00000100:00100000:0.0:1787784683.824427:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 77 00000100:00100000:0.0:1787784683.824438:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728092032:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787784683.824701:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787784683.824717:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787784682 00002000:00010000:0.0:1787784683.824719:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787784682 00002000:00010000:0.0:1787784683.824721:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787784683 -> 1787784682 00002000:00010000:0.0:1787784683.824724:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787784683.824886:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2405:x1874627728092032:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 450us (707us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787784683.824894:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 77 00000100:00100000:2.0:1787784683.831679:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784683.831823:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728092288 00000100:00100000:3.0:1787784683.831832:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728092288 00000100:00100000:3.0:1787784683.831946:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 246 00000100:00100000:3.0:1787784683.831956:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+22:12479:x1874627728092288:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787784683.832029:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.832046:0:14535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9dd70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d48 expref: 22 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.832057:0:14535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.832093:0:14535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9dd70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d48 expref: 22 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.832107:0:14535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9dd70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d48 expref: 22 pid: 7991 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784683.832122:0:14535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14535:1874627750159744:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787784683.832222:0:14535:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784683.836761:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784683.836904:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728092416 00000100:00100000:0.0:1787784683.836914:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728092416 00010000:00010000:0.0:1787784683.836969:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9dd70 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d48 expref: 23 pid: 7991 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784683.837009:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 106 00000100:00100000:0.0:1787784683.837019:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+23:2405:x1874627728092416:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784683.837035:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784683.837042:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9dd70 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d48 expref: 23 pid: 7991 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.837056:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9dd70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d48 expref: 23 pid: 7991 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.837082:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:0.0:1787784683.837088:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.837096:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.837122:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.837143:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784683.837252:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+23:2405:x1874627728092416:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 232us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784683.837270:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 106 00010000:00010000:3.0:1787784683.837710:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9dd70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d48 expref: 22 pid: 7991 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784683.837726:0:14535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14535:1874627750159744:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784683.837746:0:14535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.837850:0:14535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.837871:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.837909:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.837915:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.837922:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.837939:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784683.837944:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.837952:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.837963:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:3.0:1787784683.837966:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787784683.837970:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.837977:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9ddb6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784683.838024:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12479:x1874627728092288:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 Request processed in 6069us (6354us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787784683.838033:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 246 00000100:00100000:1.0:1787784683.843702:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784683.844608:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728092544 00000100:00100000:2.0:1787784683.844620:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728092544 00000100:00100000:2.0:1787784683.844718:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:2.0:1787784683.844730:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2405:x1874627728092544:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787784683.844788:0:8916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.844809:0:8916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026b2fa41/0x88ace7295d9dd9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d64 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.844817:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784683.844821:0:8916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784683.844825:0:8916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.844862:0:8916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026b2fa41/0x88ace7295d9dd9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d64 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.844899:0:8916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026b2fa41/0x88ace7295d9dd9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d64 expref: 8 pid: 8437 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784683.844931:0:8916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750159872:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784683.845016:0:8916:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c343b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784683.850176:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784683.850250:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728092672 00000100:00100000:3.0:1787784683.850269:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728092672 00010000:00010000:3.0:1787784683.850318:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026b2fa41/0x88ace7295d9dd9a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d64 expref: 9 pid: 8437 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784683.850367:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 107 00000100:00100000:3.0:1787784683.850378:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2405:x1874627728092672:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784683.850393:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784683.850414:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026b2fa41/0x88ace7295d9dd9a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d64 expref: 9 pid: 8437 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.850429:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026b2fa41/0x88ace7295d9dd9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d64 expref: 9 pid: 8437 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.850453:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784683.850458:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784683.850465:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.850475:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.850497:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784683.850559:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+9:2405:x1874627728092672:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 182us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784683.850568:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 107 00010000:00010000:1.0:1787784683.852219:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026b2fa41/0x88ace7295d9dd9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d64 expref: 8 pid: 8437 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784683.852243:0:8916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8916:1874627750159872:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784683.852433:0:8916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.852446:0:8916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.852453:0:8916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.852503:0:8916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.852511:0:8916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.852519:0:8916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.852526:0:8916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784683.852530:0:8916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.852539:0:8916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.852555:0:8916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.852564:0:8916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071cb2651/0x88ace7295d9ddbd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784683.852714:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2405:x1874627728092544:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 Request processed in 7986us (9021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784683.852723:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:2.0:1787784683.864685:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784683.864797:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728092928 00000100:00100000:1.0:1787784683.864806:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728092928 00000100:00100000:1.0:1787784683.864873:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 247 00000100:00100000:1.0:1787784683.864884:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+21:12479:x1874627728092928:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787784683.864983:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.865002:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9dcb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d10 expref: 21 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.865012:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.865046:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9dcb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d10 expref: 21 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.865059:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9dcb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d10 expref: 21 pid: 11332 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784683.865073:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ca940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874627750160000:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784683.865166:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3378f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784683.871347:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ca940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874627750160000:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784683.871378:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784683.872503:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784683.872804:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728093056 00000100:00100000:0.0:1787784683.872813:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728093056 00010000:00010000:0.0:1787784683.872852:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9dcb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d10 expref: 22 pid: 11332 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784683.872894:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 108 00000100:00100000:0.0:1787784683.872904:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+22:2405:x1874627728093056:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784683.872919:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784683.872935:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9dcb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d10 expref: 22 pid: 11332 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.872948:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9dcb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d10 expref: 22 pid: 11332 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.872981:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9dcb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d10 expref: 22 pid: 11332 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.873000:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:0.0:1787784683.873006:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dd15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d33 expref: 21 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.873035:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.873043:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.873051:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.873085:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784683.873147:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+21:2405:x1874627728093056:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 243us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784683.873164:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 108 00010000:00010000:2.0:1787784683.873530:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.873539:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.873717:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.873729:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9dd7e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d4f expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.873737:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.873809:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9dd7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d4f expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.873824:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9dd7e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d4f expref: 21 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784683.873845:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874627750160128:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784683.873916:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c343b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787784683.878579:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784683.878667:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728093184 00000100:00100000:3.0:1787784683.878689:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728093184 00010000:00010000:3.0:1787784683.878730:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9dd7e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d4f expref: 22 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784683.878810:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 109 00000100:00100000:3.0:1787784683.878820:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12aed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+22:2406:x1874627728093184:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784683.878835:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784683.878841:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9dd7e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d4f expref: 22 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.878854:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9dd7e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d4f expref: 22 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.878877:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:3.0:1787784683.878882:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.878891:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.878899:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.878917:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784683.878990:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12aed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+22:2406:x1874627728093184:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 171us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784683.878998:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 109 00010000:00010000:1.0:1787784683.879527:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182400/0x88ace7295d9dd7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d4f expref: 21 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784683.879559:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874627750160128:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784683.879581:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.879591:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.879597:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784683.879706:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1787784683.879842:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:1.0:1787784683.879879:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1787784683.879988:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ca940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1874627750160256:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787784683.880053:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784683.880093:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750160256 00000100:00100000:1.0:1787784683.880097:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750160256 00000100:00100000:1.0:1787784683.880133:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787784683.880142:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f012c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1874627750160256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787784683.880566:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f012c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1874627750160256:12345-0@lo:1000:mdt00_001.0 Request processed in 424us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784683.880574:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787784683.881335:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33786c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784683.881364:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ca940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1874627750160256:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787784683.881512:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:0.0:1787784683.881574:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35770c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1874627750160384:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787784683.881610:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784683.881626:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c37d7540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784683.881825:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750160384 00000100:00100000:2.0:1787784683.881832:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750160384 00000100:00100000:2.0:1787784683.881866:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787784683.881874:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3577840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6522:x1874627750160384:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787784683.881995:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3577840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6522:x1874627750160384:12345-0@lo:1000:mdt00_001.0 Request processed in 120us (383us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787784683.882002:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787784683.882815:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35770c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1874627750160384:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787784683.882860:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.882870:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.882877:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.882896:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784683.882900:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.882908:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.882923:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:0.0:1787784683.882937:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784683.882942:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.882949:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9ddcb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.882973:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dd0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.882980:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dd0e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.882985:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dd0e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.882990:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784683.882993:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dd0e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.882999:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dd0e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.883020:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:0.0:1787784683.883023:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784683.883029:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dd15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d33 expref: 24 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.883040:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dd15 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d33 expref: 24 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.883049:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dd15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d33 expref: 24 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.883080:0:6522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dd15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d33 expref: 24 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784683.883092:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874627750160512:192.168.202.41@tcp:105: 00000100:00100000:0.0:1787784683.884125:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c37d7540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784683.888378:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784683.888530:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728093312 00000100:00100000:3.0:1787784683.888539:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728093312 00000100:00100000:3.0:1787784683.888614:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:3.0:1787784683.888624:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+25:12478:x1874627728093312:12345-192.168.202.41@tcp:49:lfs.0 00000100:00100000:3.0:1787784683.888763:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+25:12478:x1874627728093312:12345-192.168.202.41@tcp:49:lfs.0 Request processed in 140us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784683.888794:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:0.0:1787784683.889714:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874627750160512:192.168.202.41@tcp:105: 00010000:00010000:0.0:1787784683.889742:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dd0e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889753:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9dd0e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889806:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ddd2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889818:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ddd2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889840:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ddd2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889850:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ddd2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889856:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ddd2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889863:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ddd2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889869:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784683.889872:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ddd2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889879:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ddd2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889889:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:0.0:1787784683.889891:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784683.889895:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ddd2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889900:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ddd2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889909:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889914:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.889923:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.890052:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784683.890056:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.890062:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.890071:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:0.0:1787784683.890073:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787784683.890076:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.890082:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9ddc4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784683.890308:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+24:12479:x1874627728092928:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 25424us (25631us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787784683.890318:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 247 00000020:00080000:0.0:1787784683.890323:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787784683.892246:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784683.892255:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784683.892745:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787784683.892755:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787784683.898234:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784683.898448:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784683.898532:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728093824 00000100:00100000:2.0:1787784683.898542:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728093824 00000100:00100000:2.0:1787784683.898605:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 248 00000100:00100000:2.0:1787784683.898617:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+24:12478:x1874627728093824:12345-192.168.202.41@tcp:58:lfs.0 00000040:00080000:2.0:1787784683.898826:0:7991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787784683.898909:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+24:12478:x1874627728093824:12345-192.168.202.41@tcp:58:lfs.0 Request processed in 295us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784683.898917:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 248 00000100:00100000:0.0:1787784683.901584:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728093568 00000100:00100000:0.0:1787784683.901601:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728093568 00000100:00100000:0.0:1787784683.901667:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:0.0:1787784683.901677:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fa975c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+24:12479:x1874627728093568:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787784683.901962:0:14224:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787784683.901993:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:0.0:1787784683.902043:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ddd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.902060:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ddd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.902072:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ddd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.902080:0:14224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ddd9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.902087:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ddd9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.902093:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ddd9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.902110:0:14224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787784683.902220:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fa975c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+26:12479:x1874627728093568:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 543us (3995us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787784683.902229:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00000020:00080000:0.0:1787784683.902234:0:14224:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787784683.902556:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784683.902564:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ddd9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.902571:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784683.902574:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ddd9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.902589:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ddd9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.902603:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:2.0:1787784683.902606:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787784683.902611:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ddd9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.902616:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ddd9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.902629:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784683.902630:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784683.902632:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784683.946237:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784683.946352:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728093952 00000100:00100000:0.0:1787784683.946363:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728093952 00000100:00100000:0.0:1787784683.946433:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 249 00000100:00100000:0.0:1787784683.946444:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+26:12481:x1874627728093952:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784683.946469:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784683.946491:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9dde0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d6b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.946577:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9dde7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.946592:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9dde7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.946604:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9dde7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.946621:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9ddee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.946629:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9ddee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.946635:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9ddee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.946724:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9ddf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.946736:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d2c expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.946745:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9ddf5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.946830:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d2c expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.946844:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d2c expref: 27 pid: 6522 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784683.946866:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874627750160640:192.168.202.41@tcp:104: 00000100:00100000:0.0:1787784683.946968:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c37d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784683.956417:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874627750160640:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784683.956453:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9ddf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784683.961190:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784683.964100:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728094208 00000100:00100000:2.0:1787784683.964115:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728094208 00000100:00100000:2.0:1787784683.964232:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:2.0:1787784683.964243:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+28:6179:x1874627728094208:12345-192.168.202.41@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787784683.964504:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+29:6179:x1874627728094208:12345-192.168.202.41@tcp:35:ldlm_bl.0 Request processed in 262us (3325us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787784683.964512:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:2.0:1787784683.968326:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784683.968414:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728094336 00000100:00100000:0.0:1787784683.968423:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728094336 00010000:00010000:0.0:1787784683.968459:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d2c expref: 29 pid: 6522 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784683.968541:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 110 00000100:00100000:0.0:1787784683.968550:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+29:2405:x1874627728094336:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784683.968564:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784683.968570:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d2c expref: 29 pid: 6522 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.968593:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d2c expref: 29 pid: 6522 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.968614:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9dd00 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d2c expref: 29 pid: 6522 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.968630:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:0.0:1787784683.968636:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9ddf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.968661:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9ddf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.968669:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9ddf5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.968697:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784683.968754:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+28:2405:x1874627728094336:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 205us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784683.968761:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 110 00010000:00010000:2.0:1787784683.968858:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9ddf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.968867:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9ddf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784683.968916:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787784683.968935:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787784683.968956:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9ddf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.968967:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9ddf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.968986:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9dde7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.968992:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9dde7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.968999:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9dde7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969004:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784683.969009:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9dde7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969017:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9dde7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969025:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:2.0:1787784683.969027:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784683.969031:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9dde7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969037:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9dde7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969049:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9ddee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969065:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9ddee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969071:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9ddee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969076:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784683.969079:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9ddee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969085:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9ddee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969092:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8951f5128900) 00010000:00010000:2.0:1787784683.969094:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784683.969097:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9ddee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969102:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629200/0x88ace7295d9ddee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969133:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9dde0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d6b expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969144:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9ddf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d6b expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.969151:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:2.0:1787784683.969153:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784683.969159:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629000, rc 0) 00000100:00100000:2.0:1787784683.969183:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+27:12481:x1874627728093952:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 22742us (22957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784683.969190:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 249 00010000:00010000:1.0:1787784684.038324:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784684.166097:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784684.166122:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750160768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784684.166195:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784684.166463:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750160768 00000100:00100000:1.0:1787784684.166473:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750160768 00000100:00100000:1.0:1787784684.166541:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787784684.166552:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750160768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787784684.166581:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787784684.166629:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750160768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784684.166636:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787784684.166682:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750160768:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787784684.166897:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784684.173603:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784684.173635:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750160896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784684.173733:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784684.174053:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750160896 00000100:00100000:3.0:1787784684.174061:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750160896 00000100:00100000:3.0:1787784684.174161:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787784684.174171:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750160896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784684.174195:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787784684.174243:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750160896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784684.174250:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1787784684.174281:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784684.174723:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750160896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784684.174978:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750161280:0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.175018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784684.175041:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750161792:0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.175068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784684.175097:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787784684.175102:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3575680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750161408:0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.175125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784684.175140:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750161920:0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.175162:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784684.175193:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750161280 00000100:00100000:0.0:1787784684.175197:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750161280 00000100:00100000:0.0:1787784684.175229:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787784684.175249:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750161280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.175304:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750161280:12345-0@lo:400:kworker.0 Request processed in 55us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784684.175310:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787784684.175330:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750161792 00000100:00100000:0.0:1787784684.175334:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750161792 00000100:00100000:0.0:1787784684.175364:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750161408 00000100:00100000:0.0:1787784684.175367:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750161408 00000100:00100000:0.0:1787784684.175397:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787784684.175405:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750161792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.175435:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750161792:12345-0@lo:400:kworker.0 Request processed in 32us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784684.175441:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787784684.175453:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787784684.175459:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c41661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750161408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.175487:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c41661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750161408:12345-0@lo:400:kworker.0 Request processed in 28us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784684.175493:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787784684.175516:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750161920 00000100:00100000:0.0:1787784684.175520:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750161920 00000100:00100000:0.0:1787784684.175543:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787784684.175549:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750161920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.175578:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750161920:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784684.175584:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1787784684.175598:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784684.175623:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3575680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750161408:0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.175645:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750161920:0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.175654:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750161280:0@lo:400:kworker.0 00010000:00080000:0.0:1787784684.175666:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3575a40 x1874627750161792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784684.175675:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750161792:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.175927:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3574780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750161152:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.175960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784684.175990:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3576940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750161664:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176012:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784684.176032:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3574b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750162176:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176052:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784684.176072:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787784684.176079:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750161024:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176105:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784684.176128:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3576d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750161536:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176149:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784684.176164:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750162048:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176181:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784684.176205:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750161024 00000100:00100000:1.0:1787784684.176209:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750161024 00000100:00100000:1.0:1787784684.176240:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1787784684.176246:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750161024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176304:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3645:x1874627750161024:12345-0@lo:400:kworker.0 Request processed in 57us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784684.176310:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1787784684.176339:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750161152 00000100:00100000:1.0:1787784684.176342:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750161152 00000100:00100000:1.0:1787784684.176361:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750161664 00000100:00100000:1.0:1787784684.176364:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750161664 00000100:00100000:1.0:1787784684.176381:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750162176 00000100:00100000:1.0:1787784684.176384:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750162176 00000100:00100000:1.0:1787784684.176397:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750162048 00000100:00100000:1.0:1787784684.176399:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750162048 00000100:00100000:1.0:1787784684.176412:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787784684.176418:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750161152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176447:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750161152:12345-0@lo:400:kworker.0 Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784684.176453:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787784684.176464:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787784684.176470:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750161664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176495:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750161664:12345-0@lo:400:kworker.0 Request processed in 25us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784684.176500:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787784684.176511:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787784684.176516:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750162176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176541:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750162176:12345-0@lo:400:kworker.0 Request processed in 25us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784684.176545:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787784684.176555:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787784684.176568:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750162048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176595:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750162048:12345-0@lo:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784684.176600:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787784684.176618:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750161536 00000100:00100000:1.0:1787784684.176621:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750161536 00000100:00100000:1.0:1787784684.176637:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787784684.176643:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750161536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176672:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750161536:12345-0@lo:400:kworker.0 Request processed in 30us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784684.176678:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787784684.176921:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750161024:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176933:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3576d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750161536:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176943:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3577c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750162048:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176953:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3574780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750161152:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.176961:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3576940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750161664:0@lo:400:kworker.0 00010000:00080000:1.0:1787784684.176971:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3574b40 x1874627750162176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784684.176980:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3574b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750162176:0@lo:400:kworker.0 00000100:00080000:0.0:1787784684.177256:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787784684.177260:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787784684.937726:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787784684.937740:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784684.946354:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787784684.946376:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787784684.946602:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1874627750162304:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787784684.946746:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c343b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787784684.965911:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784684.965936:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1874627750162304:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787784684.966014:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728094464 00000100:00100000:0.0:1787784684.966023:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728094464 00000100:00100000:0.0:1787784684.966118:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 250 00000100:00100000:0.0:1787784684.966130:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+27:12493:x1874627728094464:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787784684.966184:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787784684.966338:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+27:12493:x1874627728094464:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 209us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784684.966347:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 250 00000100:00080000:1.0:1787784684.966971:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784684.970878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784684.970938:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728094720 00000100:00100000:2.0:1787784684.970949:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728094720 00000100:00100000:2.0:1787784684.971026:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 251 00000100:00100000:2.0:1787784684.971038:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+27:12493:x1874627728094720:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784684.971068:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784684.971094:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9ddfc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d72 expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.971236:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9de03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.971256:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9de03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.971297:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9de03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784684.971313:0:14535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787784684.971459:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9ddfc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d72 expref: 30 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.971481:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9de03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d72 expref: 29 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.971492:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:2.0:1787784684.971495:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784684.971500:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4182000, rc 0) 00000100:00100000:2.0:1787784684.971576:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+29:12493:x1874627728094720:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 541us (714us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787784684.971585:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 251 00000100:00100000:2.0:1787784684.988019:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784684.988074:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728094976 00000100:00100000:2.0:1787784684.988088:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728094976 00000100:00100000:2.0:1787784684.988160:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 252 00000100:00100000:2.0:1787784684.988173:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+29:12493:x1874627728094976:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787784684.988290:0:7991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9de11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.988314:0:7991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9de11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.988329:0:7991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9de11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.988553:0:7991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9de11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.988561:0:7991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9de11 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.988569:0:7991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9de11 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.988577:0:7991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784684.988582:0:7991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9de11 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.988591:0:7991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9de11 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.991463:0:7991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:2.0:1787784684.991476:0:7991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787784684.991490:0:7991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9de11 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.991503:0:7991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9de11 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784684.992044:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+30:12493:x1874627728094976:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 3863us (4031us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787784684.992059:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 252 00000040:00080000:2.0:1787784684.992227:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787784684.992233:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784684.993311:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787784684.993332:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787784684.997660:0:14722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787784684.997679:0:14722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787784684.997735:0:14722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787784684.997747:0:14722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787784685.005411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784685.005583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784685.005698:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728095360 00000100:00100000:1.0:1787784685.005711:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728095360 00000100:00100000:1.0:1787784685.005806:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:1.0:1787784685.005818:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+30:12493:x1874627728095360:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787784685.006359:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+31:12493:x1874627728095360:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 541us (773us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787784685.006369:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:3.0:1787784685.012135:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728095104 00000100:00100000:3.0:1787784685.012153:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728095104 00000100:00100000:3.0:1787784685.012320:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:3.0:1787784685.012333:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+31:2407:x1874627728095104:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784685.012354:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784685.012396:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182000/0x88ace7295d9de03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d72 expref: 31 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.012433:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:3.0:1787784685.012439:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784685.012535:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+30:2407:x1874627728095104:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 204us (7138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784685.012545:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00010000:00010000:3.0:1787784685.063043:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784685.179385:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784685.179614:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728095616 00000100:00100000:2.0:1787784685.179626:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728095616 00000100:00100000:2.0:1787784685.179707:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 253 00000100:00100000:2.0:1787784685.179719:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+30:12506:x1874627728095616:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784685.179762:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784685.179876:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9de18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d79 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.180080:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9de1f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.180099:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9de1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.180114:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9de1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784685.180128:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787784685.180449:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182c00/0x88ace7295d9de18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d79 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.180470:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9de1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d79 expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.180480:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:2.0:1787784685.180483:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787784685.180488:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183c00, rc 0) 00000100:00100000:2.0:1787784685.180577:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+32:12506:x1874627728095616:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 860us (1209us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787784685.180606:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 253 00000100:00100000:2.0:1787784685.188462:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784685.188552:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728095744 00000100:00100000:3.0:1787784685.188565:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728095744 00000100:00100000:3.0:1787784685.188636:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 254 00000100:00100000:3.0:1787784685.188649:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+32:12506:x1874627728095744:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:3.0:1787784685.188747:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.189124:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.189141:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.189458:0:14535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.189469:0:14535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.189478:0:14535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.189486:0:14535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784685.189507:0:14535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.189516:0:14535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.189532:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:3.0:1787784685.189536:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787784685.189541:0:14535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.189549:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784685.189709:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e90d38f-8956-47bc-80da-c902c22ae09c+32:12506:x1874627728095744:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 1059us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784685.189729:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 254 00000100:00100000:1.0:1787784685.313138:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784685.313195:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728095872 00000100:00100000:1.0:1787784685.313208:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728095872 00000100:00100000:1.0:1787784685.313295:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00100000:1.0:1787784685.313307:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2408:x1874627728095872:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:1.0:1787784685.313331:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784685.313357:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9de34 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d80 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787784685.313389:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8f6dea, atime: 0x6a8f6dea, ctime: 0x6a8f6dea, blocks: 0x8 00010000:00010000:1.0:1787784685.313414:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1787784685.313420:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784685.313431:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9de34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d80 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.313469:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9de34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d80 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.313485:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602000, rc 0) 00000100:00100000:1.0:1787784685.313556:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2408:x1874627728095872:12345-192.168.202.41@tcp:101:cat.0 Request processed in 252us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784685.313564:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00080000:1.0:1787784685.313589:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784685.331953:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784685.332910:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728096000 00000100:00100000:2.0:1787784685.332928:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728096000 00002000:00100000:2.0:1787784685.333016:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8950c43b3840 x1874627728096000/t0(0) o3->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:566/0 lens 488/0 e 0 to 0 dl 1787784696 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787784685.333030:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c43b3840 with x1874627728096000 ext(0->4095) 00002000:00010000:2.0:1787784685.333037:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c43b3840 00000100:00100000:2.0:1787784685.333071:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:2.0:1787784685.333082:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2408:x1874627728096000:12345-192.168.202.41@tcp:3:cat.0 00000100:00100000:2.0:1787784685.333454:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2408:x1874627728096000:12345-192.168.202.41@tcp:3:cat.0 Request processed in 372us (1515us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787784685.333464:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00002000:00100000:2.0:1787784685.333472:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8950c43b3840 x1874627728096000/t0(0) o3->2e90d38f-8956-47bc-80da-c902c22ae09c@192.168.202.41@tcp:566/0 lens 488/4536 e 0 to 0 dl 1787784696 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787784685.333481:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8950c43b3840 with x1874627728096000 ext(0->4095) 00002000:00010000:2.0:1787784685.333484:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8950c43b3840 00000100:00100000:2.0:1787784685.706186:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4166940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750162432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784685.706286:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784685.706433:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750162432 00000100:00100000:0.0:1787784685.706445:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750162432 00000100:00100000:0.0:1787784685.706521:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787784685.706533:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750162432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784685.706580:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787784685.706701:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750162432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 170us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784685.706711:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787784685.706817:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4166940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750162432:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787784686.089051:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784687.113315:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784687.906586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784687.906651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784687.906690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784687.906718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784687.906736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784687.906758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784687.906910:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728096384 00000100:00100000:1.0:1787784687.906922:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728096384 00000100:00100000:1.0:1787784687.907000:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728096896 00000100:00100000:1.0:1787784687.907003:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728096896 00000100:00100000:1.0:1787784687.907024:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728096256 00000100:00100000:1.0:1787784687.907027:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728096256 00000100:00100000:1.0:1787784687.907053:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 368 00000100:00100000:1.0:1787784687.907064:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4166940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728096384:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784687.907162:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4166940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728096384:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 100us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784687.907171:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 368 00000100:00100000:1.0:1787784687.907191:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 369 00000100:00100000:1.0:1787784687.907198:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728096896:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784687.907226:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728096896:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 29us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784687.907276:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 369 00000100:00100000:1.0:1787784687.907289:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 370 00000100:00100000:1.0:1787784687.907297:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3576940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+32:2408:x1874627728096256:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784687.907333:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3576940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+32:2408:x1874627728096256:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 37us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784687.907340:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 370 00000100:00080000:1.0:1787784687.907365:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784687.907371:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784687.907708:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784687.907824:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728096128 00000100:00100000:2.0:1787784687.907830:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728096128 00000100:00100000:2.0:1787784687.907870:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 428 00000100:00100000:2.0:1787784687.907879:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728096128:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784687.908061:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728096768 00000100:00100000:1.0:1787784687.908066:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728096768 00000100:00100000:1.0:1787784687.908103:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 371 00000100:00100000:1.0:1787784687.908111:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3577c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728096768:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784687.908499:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728096640 00000100:00100000:0.0:1787784687.908505:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728096640 00000100:00100000:0.0:1787784687.908543:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728096512 00000100:00100000:0.0:1787784687.908547:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728096512 00000100:00100000:0.0:1787784687.908571:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 111 00000100:00100000:0.0:1787784687.908580:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728096640:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784687.908716:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728096128:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 837us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784687.908726:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 428 00000100:00100000:1.0:1787784687.908873:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3577c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728096768:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 761us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784687.908881:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 371 00000100:00100000:1.0:1787784687.908918:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 112 00000100:00100000:1.0:1787784687.908926:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2408:x1874627728096512:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784687.908959:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+8:2408:x1874627728096512:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 35us (2201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784687.908966:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 112 00000100:00080000:1.0:1787784687.909003:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787784687.909007:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784687.909010:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784687.909352:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728096640:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 771us (2658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784687.909361:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 111 00010000:00010000:2.0:1787784688.137591:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787784688.774090:0:8915:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 429023317754ns, next at 430023313542ns, rc = 0 00000100:00100000:3.0:1787784688.774122:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784688.774149:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750162560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784688.774252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784688.774334:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750162560 00000100:00100000:3.0:1787784688.774342:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750162560 00000100:00100000:3.0:1787784688.774420:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787784688.774432:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874627750162560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784688.774473:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787784688.774527:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874627750162560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784688.774535:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1787784688.774573:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784688.774622:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750162560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784688.775011:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784688.775025:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750162688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784688.775081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784688.775491:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750162688 00000100:00100000:1.0:1787784688.775499:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750162688 00000100:00100000:1.0:1787784688.775564:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787784688.775575:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750162688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784688.775608:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787784688.775665:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750162688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784688.775672:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787784688.775708:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750162688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784688.777029:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750162816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787784688.777088:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784688.777257:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750162816 00000100:00100000:2.0:1787784688.777266:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750162816 00000100:00100000:2.0:1787784688.777332:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787784688.777343:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750162816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784688.777368:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787784688.777427:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750162816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784688.777435:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:3.0:1787784688.777544:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784688.777610:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750162816:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787784689.158431:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784689.286346:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3576d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750162944:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.286417:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750163072:0@lo:400:kworker.0 00000100:00100000:3.0:1787784689.286565:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750163200:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.286626:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784689.286692:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3575680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750163584:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.286717:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784689.286742:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750164096:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.286801:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784689.286837:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787784689.286844:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750163456:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.286867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784689.286884:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff455a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750163968:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.286906:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784689.286966:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750163072 00000100:00100000:0.0:1787784689.286976:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750163072 00000100:00100000:0.0:1787784689.287029:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750163584 00000100:00100000:0.0:1787784689.287032:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750163584 00000100:00100000:0.0:1787784689.287062:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750163456 00000100:00100000:0.0:1787784689.287065:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750163456 00000100:00100000:0.0:1787784689.287091:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787784689.287101:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750163072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.287164:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750163072:12345-0@lo:400:kworker.0 Request processed in 64us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784689.287172:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787784689.287189:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787784689.287195:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750163584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.287266:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750163584:12345-0@lo:400:kworker.0 Request processed in 71us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784689.287273:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787784689.287285:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787784689.287291:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750163456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.287316:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750163456:12345-0@lo:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784689.287321:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787784689.287346:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750164096 00000100:00100000:0.0:1787784689.287350:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750164096 00000100:00100000:0.0:1787784689.287377:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750163968 00000100:00100000:0.0:1787784689.287380:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750163968 00000100:00100000:0.0:1787784689.287401:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787784689.287407:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750164096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.287439:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750164096:12345-0@lo:400:kworker.0 Request processed in 33us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784689.287452:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787784689.287464:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787784689.287470:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff479680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750163968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.287500:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff479680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750163968:12345-0@lo:400:kworker.0 Request processed in 31us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784689.287506:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787784689.287549:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750163456:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.287561:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff455a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750163968:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.287570:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750163072:0@lo:400:kworker.0 00010000:00080000:0.0:1787784689.287580:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3575680 x1874627750163584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784689.287590:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3575680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750163584:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.287598:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750164096:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.287651:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750163328:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.287680:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784689.287697:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750163840:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.287716:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784689.287745:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750163328 00000100:00100000:0.0:1787784689.287749:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750163328 00000100:00100000:0.0:1787784689.287797:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750163840 00000100:00100000:0.0:1787784689.287801:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750163840 00000100:00100000:0.0:1787784689.287818:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787784689.287824:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750163328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.287870:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750163328:12345-0@lo:400:kworker.0 Request processed in 45us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784689.287876:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787784689.287887:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787784689.287893:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff479e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750163840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.287920:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff479e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750163840:12345-0@lo:400:kworker.0 Request processed in 27us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784689.287925:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787784689.287950:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c35752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750163328:0@lo:400:kworker.0 00010000:00080000:0.0:1787784689.287961:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff4570c0 x1874627750163840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784689.287970:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750163840:0@lo:400:kworker.0 00000100:00080000:0.0:1787784689.288039:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784689.288044:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784689.288047:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784689.288952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784689.292364:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750162944 00000100:00100000:0.0:1787784689.292388:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750162944 00000100:00100000:0.0:1787784689.292537:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1787784689.292549:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750162944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.292672:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750162944:12345-0@lo:400:kworker.0 Request processed in 125us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784689.292679:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1787784689.293491:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784689.293544:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff456940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750163712:0@lo:400:kworker.0 00000100:00100000:3.0:1787784689.293582:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784689.293606:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750164224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784689.293632:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784689.293688:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750164224 00000100:00100000:3.0:1787784689.293695:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750164224 00000100:00100000:3.0:1787784689.293737:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787784689.293746:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750164224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784689.293815:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784689.293862:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750164224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784689.293870:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787784689.293893:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750163712 00000100:00100000:3.0:1787784689.293896:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750163712 00000100:00100000:3.0:1787784689.293940:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1787784689.293947:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750163712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784689.293997:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750163712:12345-0@lo:400:kworker.0 Request processed in 51us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784689.294004:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00080000:3.0:1787784689.294021:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784689.294062:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff456940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750163712:0@lo:400:kworker.0 00000100:00100000:3.0:1787784689.294107:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750164224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784689.294164:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750163200 00000100:00100000:3.0:1787784689.294168:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750163200 00000100:00100000:3.0:1787784689.294380:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787784689.294390:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750163200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784689.294433:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750163200:12345-0@lo:400:kworker.0 Request processed in 46us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784689.294439:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787784689.294464:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3575a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750163200:0@lo:400:kworker.0 00000100:00100000:3.0:1787784689.294476:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784689.294481:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750164352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784689.294506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784689.294550:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3576d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750162944:0@lo:400:kworker.0 00000100:00100000:3.0:1787784689.294583:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750164352 00000100:00100000:3.0:1787784689.294586:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750164352 00000100:00100000:3.0:1787784689.294609:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787784689.294615:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750164352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787784689.294625:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787784689.294657:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750164352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784689.294663:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787784689.294689:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750164352:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1787784689.813074:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1787784689.813092:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1787784689.820668:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000004:00080000:3.0:1787784689.820844:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:3.0:1787784689.820884:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1787784689.820908:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8950c37d7f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787784689.820914:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8951d08d4400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8951c4e32240 00000020:00080000:3.0:1787784689.820917:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8951d08d4600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8950c311da00 00000020:00080000:3.0:1787784689.820932:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:2.0:1787784689.821017:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784689.821053:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750164480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787784689.821139:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784689.821293:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750164480 00000100:00100000:3.0:1787784689.821301:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750164480 00000100:00100000:3.0:1787784689.821360:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787784689.821371:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750164480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787784689.821551:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787784689.821555:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1787784682 -> 1787784682 00002000:00010000:3.0:1787784689.821558:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1787784682 -> 1787784682 00002000:00010000:3.0:1787784689.821560:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787784682 -> 1787784682 00002000:00010000:3.0:1787784689.821562:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787784689.821611:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750164480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 241us (471us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787784689.821620:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:1.0:1787784689.821742:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ddaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784689.821753:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ddaf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784689.821763:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ddaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784689.821967:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1787784689.821973:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8950c43b0780, transno 4294967323 00000004:00080000:3.0:1787784689.821983:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1787784689.822013:0:3647:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8951c12ade00 x1874627750164480/t4294967326(4294967326) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787784705 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787784689.822027:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8951c12ade00/2, rc 0, transno 4294967326 00000100:00100000:3.0:1787784689.822033:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750164480:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787784689.822107:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784689.822113:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ddaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784689.822123:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ddaf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784689.822146:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8950c26a3500) 00010000:00010000:1.0:1787784689.822172:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784689.822179:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ddaf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784689.822186:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602400/0x88ace7295d9ddaf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7991 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787784689.822298:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787784689.822356:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000040:00080000:3.0:1787784690.120263:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784690.120283:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784690.120312:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787784690.120321:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787784690.184995:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784690.674462:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784690.675849:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728097024 00000100:00100000:2.0:1787784690.675866:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728097024 00000100:00100000:2.0:1787784690.675952:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 255 00000100:00100000:2.0:1787784690.675969:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+18:12167:x1874627728097024:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787784690.676150:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+18:12167:x1874627728097024:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 188us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784690.676160:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 255 00000100:00080000:3.0:1787784690.676575:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784690.681896:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784690.681988:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728097152 00000100:00100000:2.0:1787784690.682002:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728097152 00000100:00100000:2.0:1787784690.682095:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 256 00000100:00100000:2.0:1787784690.682112:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:12167:x1874627728097152:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787784690.682255:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:12167:x1874627728097152:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 150us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784690.682264:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 256 00000100:00080000:3.0:1787784690.683179:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784690.684495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784690.685046:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728097408 00000100:00100000:3.0:1787784690.685059:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728097408 00000100:00100000:3.0:1787784690.685136:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:3.0:1787784690.685148:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+18:12167:x1874627728097408:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787784690.696163:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+19:12167:x1874627728097408:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 11002us (11664us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787784690.696180:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:1.0:1787784690.824313:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784690.825185:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750164608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784690.825307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784690.825958:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750164608 00000100:00100000:3.0:1787784690.825975:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750164608 00000100:00100000:3.0:1787784690.826053:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787784690.826065:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750164608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784690.826127:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787784690.826227:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750164608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784690.826236:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787784690.826346:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750164608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784690.948187:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784690.948281:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728097536 00000100:00100000:3.0:1787784690.948293:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728097536 00000100:00100000:3.0:1787784690.948472:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 257 00000100:00100000:3.0:1787784690.948484:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:12962:x1874627728097536:12345-192.168.202.41@tcp:101:lsof.0 00010000:00010000:3.0:1787784690.948512:0:14535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784690.948548:0:14535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9de3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d87 expref: -99 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784690.948633:0:14535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784690.948667:0:14535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784690.948682:0:14535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784690.948733:0:14535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787784690.948745:0:14535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787784690.948805:0:14535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784690.948828:0:14535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712600/0x88ace7295d9de3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d87 expref: 7 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784690.948846:0:14535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d87 expref: 6 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784690.948853:0:14535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5138800) 00010000:00010000:3.0:1787784690.948855:0:14535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784690.948858:0:14535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713600, rc 0) 00000100:00100000:3.0:1787784690.948926:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:12962:x1874627728097536:12345-192.168.202.41@tcp:101:lsof.0 Request processed in 444us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784690.948933:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 257 00000100:00080000:0.0:1787784690.949745:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787784691.206175:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784692.038714:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784692.230031:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784693.022256:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784693.022377:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784693.022413:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784693.022474:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728098048 00000100:00100000:1.0:1787784693.022488:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728098048 00000100:00100000:1.0:1787784693.022859:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00100000:1.0:1787784693.022873:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2408:x1874627728098048:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784693.022983:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2408:x1874627728098048:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 113us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784693.022991:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00080000:3.0:1787784693.023487:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784693.023810:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784693.023851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784693.023901:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728097664 00000100:00100000:1.0:1787784693.023910:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728097664 00000100:00100000:1.0:1787784693.023957:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 430 00000100:00100000:1.0:1787784693.023968:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728097664:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784693.024022:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2408:x1874627728097664:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 55us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784693.024050:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 430 00000100:00100000:0.0:1787784693.024281:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728097792 00000100:00100000:0.0:1787784693.024287:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728097792 00000100:00100000:0.0:1787784693.024334:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728098304 00000100:00100000:0.0:1787784693.024345:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728098304 00000100:00100000:0.0:1787784693.024377:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 378 00000100:00100000:0.0:1787784693.024385:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+19:2408:x1874627728097792:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784693.024430:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+19:2408:x1874627728097792:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 46us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784693.024435:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 378 00000100:00100000:0.0:1787784693.024448:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 379 00000100:00100000:0.0:1787784693.024453:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2408:x1874627728098304:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784693.024474:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2408:x1874627728098304:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 21us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784693.024480:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 379 00000100:00080000:1.0:1787784693.025332:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784693.026121:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784693.026171:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784693.026234:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728098176 00000100:00100000:1.0:1787784693.026245:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728098176 00000100:00100000:1.0:1787784693.026325:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 116 00000100:00100000:1.0:1787784693.026336:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728098176:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784693.026417:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728098176:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 83us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784693.026425:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 116 00000100:00080000:1.0:1787784693.026449:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784693.028635:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728097920 00000100:00100000:3.0:1787784693.028655:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728097920 00000100:00100000:3.0:1787784693.028749:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728098432 00000100:00100000:3.0:1787784693.028753:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728098432 00000100:00100000:3.0:1787784693.028808:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 380 00000100:00100000:3.0:1787784693.028838:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728097920:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784693.028954:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2408:x1874627728097920:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 118us (5109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784693.028962:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 380 00000100:00100000:3.0:1787784693.028982:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 381 00000100:00100000:3.0:1787784693.028989:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728098432:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784693.029016:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2408:x1874627728098432:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (2845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784693.029023:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 381 00000100:00080000:2.0:1787784693.031246:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787784693.254101:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784693.894333:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750164736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784693.894438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784693.894799:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784693.894807:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff478b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750164864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784693.894845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784693.895152:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750164864 00000100:00100000:3.0:1787784693.895163:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750164864 00000100:00100000:2.0:1787784693.895164:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750164736 00000100:00100000:2.0:1787784693.895169:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750164736 00000100:00100000:3.0:1787784693.895232:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787784693.895232:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787784693.895243:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750164864:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784693.895243:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750164736:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:3.0:1787784693.895285:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:2.0:1787784693.895285:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787784693.895340:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750164736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784693.895348:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787784693.895365:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1787784693.895373:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784693.895376:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750164992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784693.895408:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784693.895487:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750164992 00000100:00100000:2.0:1787784693.895492:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750164992 00000100:00100000:2.0:1787784693.895535:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787784693.895542:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff456940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750164992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784693.895552:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787784693.895585:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff456940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750164992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784693.895592:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1787784693.895601:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784693.895633:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750164992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784693.898465:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750164864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3208us (3612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784693.898484:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787784693.898849:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff478b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750164864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784693.898881:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750164736:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787784694.279368:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784694.406150:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784694.406193:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750165248:0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.406301:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784694.406454:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2361e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750165376:0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.406483:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784694.406505:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750165888:0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.406528:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784694.406551:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787784694.406557:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2360b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750165760:0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.406577:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784694.406592:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2363840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750166272:0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.406614:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784694.406639:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750165376 00000100:00100000:1.0:1787784694.406647:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750165376 00000100:00100000:1.0:1787784694.406710:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787784694.406716:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750165376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.406793:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750165376:12345-0@lo:400:kworker.0 Request processed in 76us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784694.406799:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787784694.406820:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750166272 00000100:00100000:1.0:1787784694.406823:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750166272 00000100:00100000:1.0:1787784694.406858:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787784694.406865:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750166272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.406896:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750166272:12345-0@lo:400:kworker.0 Request processed in 32us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784694.406903:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1787784694.406917:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784694.406944:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1787784694.406949:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8950c36c8000, transno 4294967311 00000100:00100000:1.0:1787784694.406960:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2363840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750166272:0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.406968:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2361e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750165376:0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.407153:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750165120:0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.407199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784694.407239:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2362940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750165632:0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.407263:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784694.407282:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750166144:0@lo:400:kworker.0 00000100:00100000:3.0:1787784694.407296:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2362580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750165504:0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.407305:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784694.407328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784694.407365:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750166016:0@lo:400:kworker.0 00000100:00100000:3.0:1787784694.407386:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784694.407402:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750165248 00000100:00100000:0.0:1787784694.407407:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750165248 00000100:00100000:3.0:1787784694.407414:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750165888 00000100:00100000:3.0:1787784694.407417:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750165888 00000100:00100000:0.0:1787784694.407434:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750165760 00000100:00100000:0.0:1787784694.407437:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750165760 00000100:00100000:3.0:1787784694.407440:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750165632 00000100:00100000:3.0:1787784694.407442:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750165632 00000100:00100000:3.0:1787784694.407463:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750165504 00000100:00100000:0.0:1787784694.407463:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750166016 00000100:00100000:3.0:1787784694.407465:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750165504 00000100:00100000:0.0:1787784694.407466:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750166016 00000100:00100000:3.0:1787784694.407478:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787784694.407483:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750165248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784694.407523:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750165248:12345-0@lo:400:kworker.0 Request processed in 39us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784694.407547:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750165120 00000100:00100000:1.0:1787784694.407552:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750165120 00000100:00100000:1.0:1787784694.407586:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1787784694.407593:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3647:x1874627750165120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.407638:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee96db03-39cf-4d18-a974-880a628ded6e+24:3647:x1874627750165120:12345-0@lo:400:kworker.0 Request processed in 46us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784694.407645:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1787784694.407674:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750166144 00000100:00100000:1.0:1787784694.407677:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750166144 00000100:00100000:1.0:1787784694.407713:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787784694.407720:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5316580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750166144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.407753:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5316580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750166144:12345-0@lo:400:kworker.0 Request processed in 33us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784694.407758:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787784694.407813:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750165120:0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.407825:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750166144:0@lo:400:kworker.0 00000100:00100000:0.0:1787784694.408471:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1787784694.408486:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750165888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784694.408535:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750165888:12345-0@lo:400:kworker.0 Request processed in 56us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784694.408542:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1787784694.408563:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1787784694.408569:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750165632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784694.408602:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750165632:12345-0@lo:400:kworker.0 Request processed in 34us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784694.408608:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1787784694.408619:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1787784694.408626:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750165760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784694.408655:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750165760:12345-0@lo:400:kworker.0 Request processed in 30us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784694.408661:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1787784694.408674:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787784694.408681:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750165504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784694.408715:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750165504:12345-0@lo:400:kworker.0 Request processed in 35us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784694.408721:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787784694.408734:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1787784694.408742:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750166016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784694.408790:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750166016:12345-0@lo:400:kworker.0 Request processed in 49us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784694.408806:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1787784694.408846:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2362580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750165504:0@lo:400:kworker.0 00010000:00080000:0.0:1787784694.408862:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c23621c0 x1874627750166016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784694.408873:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750166016:0@lo:400:kworker.0 00000100:00100000:0.0:1787784694.408912:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2362940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750165632:0@lo:400:kworker.0 00000100:00100000:3.0:1787784694.429211:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1787784694.430229:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784694.430279:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750166400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784694.430377:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784694.430483:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750166400 00000100:00100000:1.0:1787784694.430493:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750166400 00000100:00100000:1.0:1787784694.430561:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787784694.430574:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750166400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787784694.430616:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784694.430675:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750166400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784694.430682:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787784694.430886:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750166400:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787784694.432038:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784694.432049:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784694.432053:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787784694.432094:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c2360b40 x1874627750165760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784694.432112:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2360b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750165760:0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.432129:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750165888:0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.432144:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750165248:0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.437361:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750166528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784694.437475:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784694.437597:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750166528 00000100:00100000:1.0:1787784694.437609:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750166528 00000100:00100000:1.0:1787784694.437676:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787784694.437689:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5317840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750166528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784694.437722:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784694.437805:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5317840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750166528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784694.437814:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787784694.440908:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750166528:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787784694.932995:0:14920:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:51:33 (1787784693) 00010000:00010000:1.0:1787784695.302253:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784695.943101:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750166656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784695.943274:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784695.943381:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750166656 00000100:00100000:2.0:1787784695.943390:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750166656 00000100:00100000:2.0:1787784695.943458:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787784695.947207:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750166656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784695.947273:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787784695.947382:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750166656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1666us (4108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784695.947392:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787784695.947650:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750166656:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1787784695.950238:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:0.0:1787784695.950258:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787784695.950311:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787784695.950333:0:6553:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1787784695.956817:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00010000:00010000:0.0:1787784696.329303:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784697.358063:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784698.145397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784698.145454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784698.145491:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728098688 00000100:00100000:1.0:1787784698.145498:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784698.145506:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728098688 00000100:00100000:1.0:1787784698.145542:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784698.145566:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728099200 00000100:00100000:3.0:1787784698.145581:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728099200 00000100:00100000:1.0:1787784698.145583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784698.145601:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728098816 00000100:00100000:0.0:1787784698.145607:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728098816 00000100:00100000:1.0:1787784698.145622:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784698.145645:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728098944 00000100:00100000:2.0:1787784698.145650:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728098944 00000100:00100000:0.0:1787784698.145653:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 388 00000100:00100000:0.0:1787784698.145670:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+18:2407:x1874627728098688:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784698.145679:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784698.145687:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728099072 00000100:00100000:2.0:1787784698.145690:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728099072 00000100:00100000:1.0:1787784698.145709:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728098560 00000100:00100000:1.0:1787784698.145713:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728098560 00000100:00100000:3.0:1787784698.145730:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728099328 00000100:00100000:2.0:1787784698.145737:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:3.0:1787784698.145739:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728099328 00000100:00100000:1.0:1787784698.145754:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 432 00000100:00100000:1.0:1787784698.145764:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2407:x1874627728098560:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784698.145831:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2361a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2407:x1874627728098944:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784698.145842:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+18:2407:x1874627728098688:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 175us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784698.145854:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 388 00000100:00100000:1.0:1787784698.145857:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2407:x1874627728098560:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 94us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784698.145860:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2361a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2407:x1874627728098944:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 99us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784698.145865:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 432 00000100:00100000:2.0:1787784698.145867:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:0.0:1787784698.145881:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 389 00000100:00100000:2.0:1787784698.145885:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00100000:0.0:1787784698.145896:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2363840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728098816:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784698.145897:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728099072:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784698.145905:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 390 00000100:00100000:1.0:1787784698.145913:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2361e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2407:x1874627728099200:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784698.145928:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728099072:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 35us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784698.145934:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00100000:0.0:1787784698.145944:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2363840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2407:x1874627728098816:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 51us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784698.145946:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2361e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2407:x1874627728099200:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 34us (448us total) trans 0 rc 0/0 00000100:00080000:2.0:1787784698.145952:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784698.145959:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787784698.145963:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784698.145963:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 389 00000100:00080000:2.0:1787784698.145968:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784698.148224:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 390 00000100:00100000:3.0:1787784698.155977:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 391 00000100:00100000:3.0:1787784698.156002:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728099328:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784698.156202:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2407:x1874627728099328:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 212us (10526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784698.156211:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 391 00010000:00010000:1.0:1787784698.375069:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784699.014019:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784699.014336:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784699.014365:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750167040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784699.014463:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784699.014882:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750167040 00000100:00100000:3.0:1787784699.014921:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750167040 00000100:00100000:3.0:1787784699.015006:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787784699.015028:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750167040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784699.015069:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787784699.015133:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750167040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784699.015154:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787784699.015212:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:3.0:1787784699.015221:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8951c12ade00, transno 4294967326 00000100:00100000:3.0:1787784699.015249:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750167040:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787784699.015268:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784699.016656:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784699.017928:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750166784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784699.018012:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784699.024560:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750166784 00000100:00100000:0.0:1787784699.024576:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750166784 00000100:00100000:0.0:1787784699.024646:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787784699.024657:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750166784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784699.024697:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787784699.024802:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750166784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (6789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784699.024810:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787784699.024942:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750166784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784699.024999:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750166912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784699.025087:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784699.025157:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750166912 00000100:00100000:1.0:1787784699.025164:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750166912 00000100:00100000:1.0:1787784699.025238:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787784699.025246:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750166912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787784699.025260:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787784699.025310:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750166912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784699.025317:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787784699.025354:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750166912:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787784699.025477:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787784699.398112:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784699.476571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784699.478780:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728099584 00000100:00100000:0.0:1787784699.478794:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728099584 00000100:00100000:0.0:1787784699.478953:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:0.0:1787784699.478965:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+18:13186:x1874627728099584:12345-192.168.202.41@tcp:35:umount.0 00000100:00100000:0.0:1787784699.479251:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+19:13186:x1874627728099584:12345-192.168.202.41@tcp:35:umount.0 Request processed in 289us (2687us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787784699.479257:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:0.0:1787784699.488292:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784699.488523:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728099840 00000100:00100000:2.0:1787784699.488532:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728099840 00000100:00100000:2.0:1787784699.488592:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:2.0:1787784699.488602:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+19:13186:x1874627728099840:12345-192.168.202.41@tcp:35:umount.0 00000100:00100000:2.0:1787784699.488935:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+20:13186:x1874627728099840:12345-192.168.202.41@tcp:35:umount.0 Request processed in 334us (652us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787784699.488941:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:3.0:1787784699.491891:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784699.492205:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728100096 00000100:00100000:0.0:1787784699.492287:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728100096 00000100:00100000:0.0:1787784699.492469:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:0.0:1787784699.492479:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fa976c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+20:13186:x1874627728100096:12345-192.168.202.41@tcp:35:umount.0 00000100:00100000:0.0:1787784699.492695:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fa976c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+21:13186:x1874627728100096:12345-192.168.202.41@tcp:35:umount.0 Request processed in 216us (819us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787784699.492703:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:1.0:1787784699.501941:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784699.502034:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728100352 00000100:00100000:0.0:1787784699.502045:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728100352 00000100:00100000:0.0:1787784699.502142:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:0.0:1787784699.502153:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2362940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+21:13186:x1874627728100352:12345-192.168.202.41@tcp:35:umount.0 00000100:00100000:0.0:1787784699.502736:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2362940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e90d38f-8956-47bc-80da-c902c22ae09c+22:13186:x1874627728100352:12345-192.168.202.41@tcp:35:umount.0 Request processed in 583us (803us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1787784699.502745:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:0.0:1787784699.507752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784699.507953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784699.508142:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784699.509040:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728100608 00000100:00100000:3.0:1787784699.509049:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728100608 00000100:00100000:2.0:1787784699.509442:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728100480 00000100:00100000:2.0:1787784699.509448:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728100480 00000100:00100000:2.0:1787784699.509513:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728100736 00000100:00100000:2.0:1787784699.509517:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728100736 00000100:00100000:2.0:1787784699.509538:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:2.0:1787784699.509546:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff455a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+15:2405:x1874627728100480:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784699.509577:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784699.509595:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629a00/0x88ace7295d9cd9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728cc expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784699.509611:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784699.509671:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff455a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+14:2405:x1874627728100480:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 124us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784699.509687:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:2.0:1787784699.509706:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1787784699.509712:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+13:2405:x1874627728100736:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784699.509720:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784699.509729:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df603600/0x88ace7295d9d06c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729b3 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784699.509737:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784699.509756:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65cfdd26-2f8c-42a9-9063-79ee47420602+12:2405:x1874627728100736:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 44us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784699.509762:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1787784699.509878:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:2.0:1787784699.509886:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65cfdd26-2f8c-42a9-9063-79ee47420602+11:2405:x1874627728100608:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784699.509894:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784699.509904:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9cd16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7288d expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784699.509913:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784699.509932:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2405:x1874627728100608:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 48us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784699.509945:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:3.0:1787784699.512643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784699.513017:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728100864 00000100:00100000:0.0:1787784699.513027:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728100864 00000100:00100000:0.0:1787784699.513089:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 81 00000100:00100000:0.0:1787784699.513099:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2404:x1874627728100864:12345-192.168.202.41@tcp:9:umount.0 00000020:00000080:0.0:1787784699.513147:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9d137 00000100:00080000:0.0:1787784699.513159:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8951c2ce6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784699.513202:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1787784699.513588:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+2:2404:x1874627728100864:12345-192.168.202.41@tcp:9:umount.0 Request processed in 490us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784699.513596:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 81 00010000:00010000:2.0:1787784699.514597:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784699.518715:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784699.518943:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728101248 00000100:00100000:1.0:1787784699.518952:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728101248 00000100:00100000:1.0:1787784699.519051:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 82 00000100:00100000:1.0:1787784699.519062:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+7:2404:x1874627728101248:12345-192.168.202.41@tcp:9:umount.0 00000020:00000080:1.0:1787784699.519092:0:8916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9d3ad 00000020:00010000:1.0:1787784699.519103:0:8916:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8950c4024800: total 0 00000100:00080000:1.0:1787784699.519109:0:8916:0:(import.c:65:import_set_state_nolock()) ffff8950c4022800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787784699.519166:0:8916:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1787784699.519341:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2404:x1874627728101248:12345-192.168.202.41@tcp:9:umount.0 Request processed in 280us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784699.519349:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 82 00000020:00010000:2.0:1787784699.519425:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8950c4024800: total 0 00010000:00010000:2.0:1787784699.519465:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8950c4024800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787784699.519513:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9de34 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d80 expref: 4 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784699.519544:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000115e9d7/0x88ace7295d9d765 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b9d expref: 3 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784699.519558:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8950c4024800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787784699.519569:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784699.519571:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784699.519573:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784699.527520:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784699.527544:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750167168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784699.527619:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784699.527687:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750167168 00000100:00100000:2.0:1787784699.527694:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750167168 00000100:00100000:2.0:1787784699.527745:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787784699.527757:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5316d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750167168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784699.527824:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787784699.527870:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5316d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750167168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784699.527878:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1787784699.527897:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784699.527944:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750167168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784699.529063:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750167296:0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.529126:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784699.529264:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750167296 00000100:00100000:2.0:1787784699.529281:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750167296 00000100:00100000:2.0:1787784699.529323:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1787784699.529331:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750167296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.529757:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750167552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784699.529822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784699.529859:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750167552 00000100:00100000:1.0:1787784699.529863:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750167552 00000100:00100000:1.0:1787784699.529915:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787784699.529922:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2362580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750167552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787784699.529939:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784699.529974:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2362580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750167552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784699.529982:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1787784699.530000:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784699.530029:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750167552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784699.530052:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750167424:0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.530089:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784699.530139:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750167424 00000100:00100000:1.0:1787784699.530143:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750167424 00000100:00100000:1.0:1787784699.530173:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1787784699.530179:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750167424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.530498:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750167424:12345-0@lo:400:kworker.0 Request processed in 318us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784699.530504:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1787784699.530535:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750167424:0@lo:400:kworker.0 00000100:00100000:2.0:1787784699.530887:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+24:3644:x1874627750167296:12345-0@lo:400:kworker.0 Request processed in 1555us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784699.530895:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1787784699.530974:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750167296:0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.533032:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750167680:0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.533432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784699.533532:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750167680 00000100:00100000:2.0:1787784699.533540:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750167680 00000100:00100000:2.0:1787784699.533589:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787784699.533599:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750167680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.533903:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750168064:0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.533937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784699.533970:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750167808:0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.533990:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784699.534005:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784699.534024:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750167936:0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.534043:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784699.534084:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750168064 00000100:00100000:1.0:1787784699.534089:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750168064 00000100:00100000:1.0:1787784699.534137:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750167808 00000100:00100000:1.0:1787784699.534141:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750167808 00000100:00100000:1.0:1787784699.534159:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750167936 00000100:00100000:1.0:1787784699.534162:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750167936 00000100:00100000:1.0:1787784699.534181:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1787784699.534187:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750168064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.534234:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750168064:12345-0@lo:400:kworker.0 Request processed in 46us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784699.534241:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1787784699.534256:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1787784699.534262:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750167808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.534291:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750167808:12345-0@lo:400:kworker.0 Request processed in 30us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784699.534297:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1787784699.534308:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1787784699.534315:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750167936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.534355:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750167936:12345-0@lo:400:kworker.0 Request processed in 41us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784699.534361:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00080000:1.0:1787784699.534379:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784699.534384:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787784699.534406:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12ade00 x1874627750168064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784699.534431:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750168064:0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.534461:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750167936:0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.534468:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750167808:0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.534615:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784699.534634:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728102272 00000100:00100000:1.0:1787784699.534638:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728102272 00000100:00100000:1.0:1787784699.534661:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 258 00000100:00100000:1.0:1787784699.534667:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+22:2404:x1874627728102272:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:1.0:1787784699.534684:0:6523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cd24 00000020:00010000:1.0:1787784699.534696:0:6523:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8951d87ab000: total 0 00000100:00080000:1.0:1787784699.534700:0:6523:0:(import.c:65:import_set_state_nolock()) ffff8951f53b5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787784699.534720:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1787784699.534868:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e90d38f-8956-47bc-80da-c902c22ae09c+21:2404:x1874627728102272:12345-192.168.202.41@tcp:39:umount.0 Request processed in 199us (253us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1787784699.534875:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 258 00000020:00010000:1.0:1787784699.534893:0:10397:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8951d87ab000: total 0 00010000:00010000:1.0:1787784699.534940:0:10397:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8951d87ab000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787784699.534972:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:1.0:1787784699.534976:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787784699.534984:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9d750 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b96 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784699.535006:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5138800) 00010000:00010000:1.0:1787784699.535009:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784699.535021:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9d7ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bb9 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784699.535038:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:1.0:1787784699.535041:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784699.535045:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9d726 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b88 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784699.535061:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:1.0:1787784699.535063:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784699.535067:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9dd15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d33 expref: 17 pid: 11332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784699.535080:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:1.0:1787784699.535083:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787784699.535087:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9d408 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ab6 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784699.535100:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951f5128c00) 00010000:00010000:1.0:1787784699.535102:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784699.535106:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9d0b2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729c8 expref: 15 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784699.535126:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8951f5128200) 00010000:00010000:1.0:1787784699.535128:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784699.535145:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9d096 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729c1 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784699.535162:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:1.0:1787784699.535170:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787784699.535176:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff895201c5a800/0x88ace7295d9d7ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72bc0 expref: 13 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784699.535190:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8951e0a67000) 00010000:00010000:1.0:1787784699.535192:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784699.535196:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34c00/0x88ace7295d9d646 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72b50 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784699.535212:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8951e0a67b00) 00010000:00010000:1.0:1787784699.535215:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787784699.535219:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183a00/0x88ace7295d9dad7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72c99 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784699.535234:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:1.0:1787784699.535237:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784699.535241:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9ddf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d6b expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784699.535255:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8950c26a3100) 00010000:00010000:1.0:1787784699.535257:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787784699.535261:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183c00/0x88ace7295d9de1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d79 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784699.535275:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8951e0a67300) 00010000:00010000:1.0:1787784699.535277:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787784699.535282:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9d10d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729dd expref: 8 pid: 7991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784699.535306:0:10397:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8951d87ab000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787784699.535321:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784699.535323:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784699.535325:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784699.536594:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750167680:12345-0@lo:400:kworker.0 Request processed in 2992us (3157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784699.536605:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787784699.536986:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784699.537056:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784699.537081:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750168320:0@lo:400:kworker.0 00000100:00100000:3.0:1787784699.537426:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784699.537466:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750168320 00000100:00100000:3.0:1787784699.537473:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750168320 00000100:00100000:3.0:1787784699.537532:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787784699.537540:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750168320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784699.537585:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750168320:12345-0@lo:400:kworker.0 Request processed in 46us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784699.537591:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00080000:3.0:1787784699.537624:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787784699.537651:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12ade00 x1874627750168320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784699.537666:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750168320:0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.537841:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750167680:0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.538281:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750168192:0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.538318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784699.538491:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750168192 00000100:00100000:1.0:1787784699.538496:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750168192 00000100:00100000:1.0:1787784699.538598:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1787784699.538607:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3576d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750168192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784699.539055:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3576d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750168192:12345-0@lo:400:kworker.0 Request processed in 449us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784699.539074:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1787784699.539314:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750168192:0@lo:400:kworker.0 00000100:00080000:3.0:1787784699.539552:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784699.549891:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784699.550392:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728102400 00000100:00100000:1.0:1787784699.550402:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728102400 00000100:00100000:1.0:1787784699.550465:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 259 00000100:00100000:1.0:1787784699.550475:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5291680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+5:2404:x1874627728102400:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:1.0:1787784699.550507:0:6522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cd2b 00000100:00080000:1.0:1787784699.550525:0:6522:0:(import.c:65:import_set_state_nolock()) ffff895201ca3000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787784699.550607:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787784699.550804:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5291680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e90d38f-8956-47bc-80da-c902c22ae09c+3:2404:x1874627728102400:12345-192.168.202.41@tcp:39:umount.0 Request processed in 329us (923us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787784699.550813:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 259 00010000:00010000:3.0:1787784699.556700:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787784700.358324:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784700.358334:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784700.358442:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787784700.358450:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787784700.424751:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784701.062379:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784701.062405:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750168448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784701.062485:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784701.062735:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750168448 00000100:00100000:2.0:1787784701.062743:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750168448 00000100:00100000:2.0:1787784701.062818:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787784701.062829:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750168448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787784701.062863:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787784701.062910:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750168448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784701.062917:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787784701.063131:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750168448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784701.326869:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784701.326978:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728102528 00000100:00100000:2.0:1787784701.326988:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728102528 00000100:00100000:2.0:1787784701.327052:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:2.0:1787784701.327077:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2407:x1874627728102528:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784701.327094:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784701.327128:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629600/0x88ace7295d9ce2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72912 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784701.327148:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784701.327215:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65cfdd26-2f8c-42a9-9063-79ee47420602+9:2407:x1874627728102528:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 140us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784701.327223:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:0.0:1787784701.333245:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784701.333313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784701.333403:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728102656 00000100:00100000:2.0:1787784701.333414:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728102656 00000100:00100000:2.0:1787784701.333489:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728102784 00000100:00100000:2.0:1787784701.333493:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728102784 00000100:00100000:2.0:1787784701.333520:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:2.0:1787784701.333535:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65cfdd26-2f8c-42a9-9063-79ee47420602+10:2408:x1874627728102656:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784701.333552:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784701.333572:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5a200/0x88ace7295d9ce27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728e1 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784701.333590:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784701.333637:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65cfdd26-2f8c-42a9-9063-79ee47420602+9:2408:x1874627728102656:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 104us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784701.333644:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:2.0:1787784701.333658:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:2.0:1787784701.333663:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65cfdd26-2f8c-42a9-9063-79ee47420602+8:2408:x1874627728102784:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784701.333671:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784701.333679:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c13fee00/0x88ace7295d9d065 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e729ac expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784701.333700:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784701.333720:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65cfdd26-2f8c-42a9-9063-79ee47420602+7:2408:x1874627728102784:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 56us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784701.333727:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:3.0:1787784701.339113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784701.349264:0:11332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728103040 00000100:00100000:1.0:1787784701.349282:0:11332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728103040 00000100:00080000:3.0:1787784701.350163:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784701.350661:0:11332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 260 00000100:00100000:1.0:1787784701.350679:0:11332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+6:2404:x1874627728103040:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:1.0:1787784701.350729:0:11332:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9ce3c 00000020:00010000:1.0:1787784701.350738:0:11332:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8950c344d800: total 0 00000100:00080000:1.0:1787784701.350743:0:11332:0:(import.c:65:import_set_state_nolock()) ffff8950c344e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787784701.350808:0:11332:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:1.0:1787784701.350978:0:11332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2404:x1874627728103040:12345-192.168.202.41@tcp:39:umount.0 Request processed in 305us (11874us total) trans 4294967529 rc 0/0 00000100:00100000:1.0:1787784701.350986:0:11332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 260 00000020:00010000:0.0:1787784701.351137:0:10397:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8950c344d800: total 0 00010000:00010000:0.0:1787784701.351142:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784701.351979:0:10397:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8950c344d800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787784701.352043:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5138800) 00010000:00010000:0.0:1787784701.352048:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784701.352061:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9de42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d87 expref: 4 pid: 14535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784701.352107:0:10397:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8950c344d800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787784701.352137:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784701.352139:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784701.352141:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784701.358859:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784701.359108:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728103168 00000100:00100000:2.0:1787784701.359128:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728103168 00000100:00100000:2.0:1787784701.359218:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 261 00000100:00100000:2.0:1787784701.359233:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+5:2404:x1874627728103168:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:2.0:1787784701.359274:0:7991:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9ce43 00000100:00080000:2.0:1787784701.359284:0:7991:0:(import.c:65:import_set_state_nolock()) ffff8950c35ac000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787784701.359322:0:7991:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787784701.359490:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e5cc6ee-e7bb-4eda-bff3-48f824501258+3:2404:x1874627728103168:12345-192.168.202.41@tcp:39:umount.0 Request processed in 261us (639us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787784701.359499:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 261 00000100:00080000:3.0:1787784701.359697:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787784701.359846:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784701.392934:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784701.393251:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728103424 00000100:00100000:0.0:1787784701.393265:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728103424 00000100:00100000:0.0:1787784701.393351:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 434 00000100:00100000:0.0:1787784701.393362:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+7:2404:x1874627728103424:12345-192.168.202.41@tcp:251:umount.0 00000020:00000080:0.0:1787784701.393413:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cd01 00000020:00010000:0.0:1787784701.393421:0:6514:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8951d87aa000: total 0 00000100:00080000:0.0:1787784701.393427:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8951d87af000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787784701.393516:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65cfdd26-2f8c-42a9-9063-79ee47420602+3:2404:x1874627728103424:12345-192.168.202.41@tcp:251:umount.0 Request processed in 155us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784701.393540:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 434 00000020:00010000:2.0:1787784701.393816:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8951d87aa000: total 0 00010000:00010000:2.0:1787784701.393872:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8951d87aa000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787784701.393907:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5aa00/0x88ace7295d9cdbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e728d3 expref: 2 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784701.393922:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8951d87aa000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787784701.393932:0:6508:0:(genops.c:885:class_export_put()) final put ffff8951d87aa000/65cfdd26-2f8c-42a9-9063-79ee47420602 00010000:00010000:2.0:1787784701.393951:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784701.393953:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784701.393955:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787784701.393996:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951d87aa000/65cfdd26-2f8c-42a9-9063-79ee47420602 for MGS 00000020:00000080:1.0:1787784701.394040:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951d87af000 for MGS 00010000:00010000:0.0:1787784701.446161:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787784702.280310:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787784702.470023:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787784703.344427:0:15117:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787784703.391135:0:15117:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787784703.391199:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.391235:0:15117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.391244:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.391252:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.391288:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787784703.391294:0:15117:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787784703.391324:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1787784703.391327:0:15117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784703.391336:0:15117:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1787784703.391342:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787784703.391344:0:15117:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1787784703.391360:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784703.391367:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787784703.391377:0:15117:0:(import.c:65:import_set_state_nolock()) ffff8951d87a8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787784703.391381:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784703.391394:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784703.391402:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784703.391419:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787784703.391423:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1787784703.391465:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750168576:0@lo:39:umount.0 00010000:00010000:3.0:1787784703.391468:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.391474:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787784703.391546:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750168704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784703.391563:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784703.391729:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.391738:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9cdb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cdb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.391754:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784703.391755:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784703.391757:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784703.392900:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750168576 00000100:00100000:1.0:1787784703.392914:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750168576 00000100:00100000:1.0:1787784703.393002:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787784703.393014:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874627750168576:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787784703.393056:0:6522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c918 00000100:00080000:1.0:1787784703.393068:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8951f81b5000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787784703.394662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784703.394707:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750168704 00000100:00100000:3.0:1787784703.394717:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750168704 00000100:00100000:2.0:1787784703.394828:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787784703.394842:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+24:3646:x1874627750168704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784703.394861:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784703.394887:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d35600/0x88ace7295d9cdb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9cdb0 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.394905:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784703.394965:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+23:3646:x1874627750168704:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784703.394994:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787784703.395010:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750168704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784703.397503:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1874627750168576:12345-0@lo:39:umount.0 Request processed in 4477us (5928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784703.397523:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1787784703.397544:0:6522:0:(genops.c:885:class_export_put()) final put ffff8951d87e9000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787784703.397674:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951d87e9000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787784703.397741:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951f81b5000 for lustre-MDT0000 00010000:00010000:1.0:1787784703.398919:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787784703.401068:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951d87a8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787784703.401104:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750168576:0@lo:39:umount.0 00000100:00080000:2.0:1787784703.401197:0:15117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784703.401202:0:15117:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787784703.401209:0:15117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787784703.403418:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404628:0:15117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404643:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404649:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404677:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784703.404686:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404693:0:15117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404700:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404706:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.404714:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784703.404725:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.404734:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784703.404739:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404745:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784703.404748:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784703.404756:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404764:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404786:0:15117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784703.404793:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784703.404793:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784703.404796:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787784703.404799:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404814:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787784703.404827:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784703.404830:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404836:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784703.404839:0:10397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404845:0:10397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.404848:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784703.404853:0:10397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.404855:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1787784703.404858:0:10397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787784703.404865:0:10397:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787784703.404868:0:10397:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787784703.404882:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404886:0:10397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.404891:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9cdc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cdcc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404892:0:10397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784703.404906:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784703.404910:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.404911:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.404917:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713400 already unused, calling callback (ffffffffc1382c20) 00010000:00010000:2.0:1787784703.404918:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff895201c5b000/0x88ace7295d9ccbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9ccc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784703.404920:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.404927:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404928:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784703.404930:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784703.404932:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1787784703.404933:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784703.404937:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787784703.404940:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787784703.404942:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787784703.404944:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031c00/0x88ace7295d9c877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404951:0:15117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031c00/0x88ace7295d9c877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.404953:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404958:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031c00/0x88ace7295d9c877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.404963:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784703.404965:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951c0031c00/0x88ace7295d9c877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.404969:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.404975:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784703.404976:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9d057 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9d05e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784703.404978:0:15117:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787784703.404981:0:15117:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1787784703.404985:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784703.404988:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0031c00/0x88ace7295d9c877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.404992:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031c00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784703.405007:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031c00/0x88ace7295d9c877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.405014:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0031c00/0x88ace7295d9c877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784703.405026:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1787784703.405027:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031c00/0x88ace7295d9c877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784703.405032:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784703.405034:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787784703.405035:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:01000004:2.0:1787784703.405039:0:15117:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:3.0:1787784703.405049:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0031c00/0x88ace7295d9c877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1787784703.405049:0:15117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:3.0:1787784703.405055:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:2.0:1787784703.405055:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1787784703.405060:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0031c00/0x88ace7295d9c877 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787784703.405062:0:15117:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1787784703.405072:0:15117:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8951ff43e000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1787784703.405076:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0031c00/0x88ace7295d9c877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9c87e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787784703.405078:0:15117:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff895201ca0800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787784703.405084:0:15117:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8951eff29000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1787784703.405086:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784703.405088:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784703.405089:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787784703.405089:0:15117:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8951fb0df000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1787784703.405108:0:15117:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8950c344d800 1e5cc6ee-e7bb-4eda-bff3-48f824501258 192.168.202.41@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787784703.405113:0:15117:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8951d87ab000 2e90d38f-8956-47bc-80da-c902c22ae09c 192.168.202.41@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000100:00100000:3.0:1787784703.405118:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750169088:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787784703.405118:0:15117:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8951f02d99b8) has exports, disconnecting them 00000020:00080000:2.0:1787784703.405123:0:15117:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8951ff43e000), last request at 1787784699 00000020:00000080:2.0:1787784703.405131:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cc28 00000100:00080000:2.0:1787784703.405151:0:15117:0:(import.c:65:import_set_state_nolock()) ffff8951ff43c800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787784703.405196:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787784703.405210:0:15117:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951ff43e000): rc 0 00000020:00000080:2.0:1787784703.405213:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951ff43e000/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:3.0:1787784703.405214:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784703.405275:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784703.405282:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750168960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784703.405303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784703.405337:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750169088 00000100:00100000:3.0:1787784703.405346:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750169088 00000100:00100000:0.0:1787784703.405913:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750168832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784703.405955:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784703.405979:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784703.405985:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750169216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784703.406005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784703.406033:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750168960 00000100:00100000:0.0:1787784703.406037:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750168960 00000100:00100000:0.0:1787784703.406083:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750168832 00000100:00100000:0.0:1787784703.406085:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750168832 00000100:00100000:0.0:1787784703.406111:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750169216 00000100:00100000:0.0:1787784703.406114:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750169216 00000100:00100000:0.0:1787784703.406132:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787784703.406141:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+26:3645:x1874627750168960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784703.406157:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784703.406177:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d35000/0x88ace7295d9ccc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9ccbb expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784703.406195:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784703.406236:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+25:3645:x1874627750168960:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784703.406243:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787784703.406263:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787784703.406285:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+24:3647:x1874627750168832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784703.406294:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784703.406305:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5ae00/0x88ace7295d9cdcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9cdc5 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784703.406314:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784703.406341:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+23:3647:x1874627750168832:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784703.406347:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787784703.406360:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787784703.406366:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+22:3647:x1874627750169216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784703.406374:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784703.406383:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c0030200/0x88ace7295d9c87e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9c877 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784703.406392:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784703.406413:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee96db03-39cf-4d18-a974-880a628ded6e+21:3647:x1874627750169216:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784703.406419:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787784703.406553:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750169216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784703.406568:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750168832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784703.406596:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784703.407195:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787784703.407206:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+20:3645:x1874627750169088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784703.407217:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784703.407230:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c13fec00/0x88ace7295d9d05e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9d057 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784703.407243:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784703.407280:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee96db03-39cf-4d18-a974-880a628ded6e+19:3645:x1874627750169088:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784703.407288:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787784703.407330:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750168960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784703.407340:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750169088:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787784703.411663:0:15117:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff895201ca0800), last request at 1787784699 00000020:00000080:2.0:1787784703.411682:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cb02 00000100:00080000:2.0:1787784703.411703:0:15117:0:(import.c:65:import_set_state_nolock()) ffff895201ca4000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787784703.411806:0:15117:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff895201ca0800): rc 0 00000020:00000080:2.0:1787784703.411809:0:15117:0:(genops.c:885:class_export_put()) final put ffff895201ca0800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787784703.414277:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ff43e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787784703.414403:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951ff43c800 for lustre-MDT0000 00010000:00010000:0.0:1787784703.414662:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787784703.415959:0:15117:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8951eff29000), last request at 1787784449 00000020:00000080:2.0:1787784703.415974:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9ca06 00000100:00080000:2.0:1787784703.415987:0:15117:0:(import.c:65:import_set_state_nolock()) ffff8951eff29800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787784703.416035:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff895201ca0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787784703.416115:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff895201ca4000 for lustre-MDT0000 00000020:00080000:3.0:1787784703.416141:0:15117:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951eff29000): rc 0 00000020:00000080:3.0:1787784703.416143:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951eff29000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1787784703.416161:0:15117:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8951fb0df000), last request at 1787784449 00000020:00000080:3.0:1787784703.416166:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c9c0 00000100:00080000:3.0:1787784703.416171:0:15117:0:(import.c:65:import_set_state_nolock()) ffff8951cfe90800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787784703.416207:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951eff29000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787784703.416240:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951eff29800 for lustre-MDT0000 00010000:00010000:0.0:1787784703.418600:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784703.418926:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787784703.419271:0:15117:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:1.0:1787784703.419387:0:15117:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951fb0df000): rc 0 00000004:00000080:1.0:1787784703.419400:0:15117:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb77a080afae0 00000100:00080000:1.0:1787784703.419427:0:15117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787784703.419433:0:15117:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1787784703.423484:0:15117:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787784703.423604:0:15117:0:(import.c:65:import_set_state_nolock()) ffff8951eff1f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787784703.423695:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750169344:0@lo:39:umount.0 00000100:00080000:1.0:1787784703.424152:0:15117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787784703.424158:0:15117:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:1.0:1787784703.424182:0:15117:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787784703.424269:0:15117:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787784703.424289:0:15117:0:(import.c:65:import_set_state_nolock()) ffff8951f67dd000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787784703.424297:0:15117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787784703.424300:0:15117:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1787784703.424316:0:15117:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787784703.424386:0:15117:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787784703.424396:0:15117:0:(import.c:65:import_set_state_nolock()) ffff8950c34fe000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787784703.424430:0:15117:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8951f02d99b8) has no exports 00000100:00100000:3.0:1787784703.425180:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784703.425313:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750169472:0@lo:9:umount.0 00000100:00100000:2.0:1787784703.425342:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750169344 00000100:00100000:3.0:1787784703.425358:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784703.425367:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750169344 00000100:00100000:3.0:1787784703.425445:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750169600:0@lo:9:umount.0 00000100:00100000:3.0:1787784703.425471:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784703.425539:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787784703.425550:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874627750169344:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787784703.425589:0:6526:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9ca68 00000100:00080000:2.0:1787784703.425601:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8951f5287800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787784703.425626:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787784703.425631:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750169472 00000100:00100000:1.0:1787784703.425635:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750169472 00000100:00100000:1.0:1787784703.425678:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750169600 00000100:00100000:1.0:1787784703.425681:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750169600 00000100:00100000:1.0:1787784703.425701:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787784703.425708:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5293840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874627750169472:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787784703.425725:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cbaa 00000100:00080000:1.0:1787784703.425739:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8950c20dd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787784703.425801:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1787784703.425906:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5293840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3643:x1874627750169472:12345-0@lo:9:umount.0 Request processed in 198us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784703.425915:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787784703.425930:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787784703.425936:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874627750169600:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787784703.425947:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9ccec 00000100:00080000:1.0:1787784703.425953:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8951ff43e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787784703.425977:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:3.0:1787784703.426194:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787784703.426199:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787784703.426299:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f67dd000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787784703.426313:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787784703.426316:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787784703.426320:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750169472:0@lo:9:umount.0 00000100:00100000:1.0:1787784703.426650:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3643:x1874627750169600:12345-0@lo:9:umount.0 Request processed in 713us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784703.426658:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787784703.426720:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c34fe000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787784703.426736:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787784703.426738:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787784703.426741:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750169600:0@lo:9:umount.0 00000100:00100000:2.0:1787784703.427635:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3643:x1874627750169344:12345-0@lo:39:umount.0 Request processed in 2082us (2454us total) trans 4294967301 rc 0/0 00010000:00010000:3.0:1787784703.427646:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784703.427648:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:1.0:1787784703.427717:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951eff1f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787784703.427726:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750169344:0@lo:39:umount.0 00010000:00010000:0.0:1787784703.429198:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784703.429537:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787784703.435133:0:15117:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8951f02d99b8) has no exports 00000020:00000080:1.0:1787784703.481535:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c8d2 00000020:00000080:1.0:1787784703.481554:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951fb0d8800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787784703.481640:0:15117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787784703.481997:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784703.482024:0:15117:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787784703.482029:0:15117:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8951cfef19b8) has no exports 00000020:00000080:0.0:1787784703.482459:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c8cb 00000020:00000080:0.0:1787784703.482466:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951fb08b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787784703.482515:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fb0d8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787784703.482765:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fb08b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787784703.483169:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784703.483178:0:15117:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787784703.483182:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951fb089800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787784703.483185:0:15117:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fb089800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787784703.483193:0:15117:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1787784703.493888:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784704.134389:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750169728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787784704.134467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784704.134636:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750169728 00000100:00100000:2.0:1787784704.134644:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750169728 00000100:00100000:2.0:1787784704.134714:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787784704.134725:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750169728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784704.134755:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787784704.134826:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750169728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784704.134834:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:3.0:1787784704.134940:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784704.135025:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750169728:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787784704.518540:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784704.646128:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5316940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750170112:0@lo:400:kworker.0 00000100:00100000:2.0:1787784704.646205:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784704.646261:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750170624:0@lo:400:kworker.0 00000100:00100000:2.0:1787784704.646300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784704.646324:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787784704.646331:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750170240:0@lo:400:kworker.0 00000100:00100000:2.0:1787784704.646368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784704.646399:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750170752:0@lo:400:kworker.0 00000100:00100000:2.0:1787784704.646425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784704.646463:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750170112 00000100:00100000:2.0:1787784704.646470:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750170112 00000100:00100000:2.0:1787784704.646505:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750170624 00000100:00100000:2.0:1787784704.646509:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750170624 00000100:00100000:2.0:1787784704.646539:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750170240 00000100:00100000:2.0:1787784704.646542:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750170240 00000100:00100000:2.0:1787784704.646558:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1787784704.646569:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff455a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750170624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784704.646620:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff455a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750170624:12345-0@lo:400:kworker.0 Request processed in 54us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784704.646627:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1787784704.646666:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787784704.646671:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874627750170112:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787784704.646677:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787784704.646703:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874627750170112:12345-0@lo:400:kworker.0 Request processed in 31us (499us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787784704.646708:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787784704.646718:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787784704.646720:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874627750170240:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787784704.646725:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787784704.646742:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874627750170240:12345-0@lo:400:kworker.0 Request processed in 20us (374us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787784704.646747:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787784704.646791:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750170752 00000100:00100000:2.0:1787784704.646795:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750170752 00000100:00100000:2.0:1787784704.646822:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787784704.646836:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750170752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784704.646868:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750170752:12345-0@lo:400:kworker.0 Request processed in 34us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784704.646874:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1787784704.646891:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784704.646896:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784704.646922:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787784704.646928:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8950c20de000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787784704.646932:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787784704.647872:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750169856:0@lo:400:kworker.0 00000100:00100000:3.0:1787784704.647928:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784704.647975:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750170368:0@lo:400:kworker.0 00000100:00100000:3.0:1787784704.647999:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784704.648035:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787784704.648042:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750169984:0@lo:400:kworker.0 00000100:00100000:3.0:1787784704.648067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784704.648095:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750170496:0@lo:400:kworker.0 00000100:00100000:3.0:1787784704.648118:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784704.648157:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750170368 00000100:00100000:3.0:1787784704.648163:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750170368 00000100:00100000:3.0:1787784704.648207:0:14535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750170496 00000100:00100000:3.0:1787784704.648210:0:14535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750170496 00000100:00100000:3.0:1787784704.648220:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1787784704.648228:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5292580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750170368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784704.648272:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5292580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750170368:12345-0@lo:400:kworker.0 Request processed in 45us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784704.648279:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1787784704.648294:0:14535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787784704.648297:0:14535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3644:x1874627750170496:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787784704.648302:0:14535:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787784704.648340:0:14535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3644:x1874627750170496:12345-0@lo:400:kworker.0 Request processed in 41us (221us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787784704.648356:0:14535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787784704.648374:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750169856 00000100:00100000:3.0:1787784704.648378:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750169856 00000100:00100000:3.0:1787784704.648405:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1787784704.648413:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f00c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+19:3644:x1874627750169856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784704.648442:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f00c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee96db03-39cf-4d18-a974-880a628ded6e+19:3644:x1874627750169856:12345-0@lo:400:kworker.0 Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784704.648455:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00080000:3.0:1787784704.648481:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784704.648492:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750169984 00000100:00100000:3.0:1787784704.648496:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750169984 00000100:00100000:3.0:1787784704.648518:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787784704.648523:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874627750169984:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787784704.648528:0:6527:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787784704.648550:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874627750169984:12345-0@lo:400:kworker.0 Request processed in 27us (483us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787784704.648556:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:3.0:1787784704.648582:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787784704.648586:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8951cfe96800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787784704.648590:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787784704.648595:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8951cfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784704.648599:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 190 00000100:00080000:3.0:1787784704.648604:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8951cfe96800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784704.648631:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951f5290f00 x1874627750170880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784704.648651:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750169984:0@lo:400:kworker.0 00000100:00080000:3.0:1787784704.648664:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787784704.648666:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8951d87ad000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787784704.648669:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787784704.648672:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8951d87ad000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784704.648675:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 237 00000100:00080000:3.0:1787784704.648686:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8951d87ad000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784704.648700:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951f5291e00 x1874627750171008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784704.648712:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750170496:0@lo:400:kworker.0 00000100:00100000:3.0:1787784704.648726:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee96db03-39cf-4d18-a974-880a628ded6e:3644:1874627750169856:0@lo:400:kworker.0 00010000:00080000:3.0:1787784704.648739:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53143c0 x1874627750170368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784704.648749:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750170368:0@lo:400:kworker.0 00000001:00100000:0.0:1787784704.650480:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787784704.650488:0:6499:0:(genops.c:885:class_export_put()) final put ffff8951fb0df000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787784704.650521:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1e5cc6ee-e7bb-4eda-bff3-48f824501258 00000001:00080000:0.0:1787784704.650540:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:0.0:1787784704.650543:0:6499:0:(genops.c:885:class_export_put()) final put ffff8950c344d800/1e5cc6ee-e7bb-4eda-bff3-48f824501258 00000001:00100000:0.0:1787784704.650552:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00000001:00080000:0.0:1787784704.650557:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1787784704.650569:0:6499:0:(genops.c:885:class_export_put()) final put ffff8951d87ab000/2e90d38f-8956-47bc-80da-c902c22ae09c 00000100:00100000:0.0:1787784704.650640:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750170880:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787784704.650701:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784704.650727:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750171008:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787784704.650812:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784704.650825:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750171136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784704.650862:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784704.650881:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784704.650903:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750171136 00000100:00100000:1.0:1787784704.650910:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750171136 00000100:00100000:0.0:1787784704.650925:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750171008 00000100:00100000:0.0:1787784704.650931:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750171008 00000100:00100000:0.0:1787784704.650964:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787784704.650975:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787784704.650975:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874627750171008:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787784704.650988:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750171136:12345-0@lo:13:osp-pre-1-1.0 00010000:02000000:0.0:1787784704.650995:0:6522:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787784704.651079:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750170880 00000100:00100000:3.0:1787784704.651093:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750170880 00000100:00100000:3.0:1787784704.651116:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787784704.651122:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750170880:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1787784704.651130:0:6527:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787784704.651183:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750170880:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 60us (482us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787784704.651190:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:3.0:1787784704.651224:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787784704.651228:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787784704.651232:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750170880:0@lo:38:ptlrpcd_00_00.0 00000020:00000080:3.0:1787784704.651267:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fb0df000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1787784704.651323:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c344d800/1e5cc6ee-e7bb-4eda-bff3-48f824501258 for lustre-MDT0000 00000020:00000080:3.0:1787784704.651346:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951d87ab000/2e90d38f-8956-47bc-80da-c902c22ae09c for lustre-MDT0000 00000020:00000080:3.0:1787784704.651376:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951cfe90800 for lustre-MDT0000 00000020:00000080:3.0:1787784704.651381:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c344e800 for lustre-MDT0000 00000020:00000080:3.0:1787784704.651392:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951f53b5000 for lustre-MDT0000 00002000:00000024:1.0:1787784704.651845:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787784704.651893:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750171136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 907us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784704.651900:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787784704.652193:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750171136:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787784704.665500:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8950c20de000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784704.665513:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 214 00000100:00080000:2.0:1787784704.665523:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8950c20de000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784704.665601:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c36c8000 x1874627750171264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784704.665701:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874627750171264:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787784704.665792:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784704.665850:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750171264 00000100:00100000:1.0:1787784704.665860:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750171264 00000100:00100000:1.0:1787784704.665904:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787784704.665912:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874627750171264:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1787784704.665930:0:7991:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787784704.666208:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750170240:0@lo:400:kworker.0 00000100:00100000:2.0:1787784704.666237:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750170752:0@lo:400:kworker.0 00000100:00080000:2.0:1787784704.666251:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787784704.666255:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8951eff2f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787784704.666258:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787784704.666262:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8951eff2f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784704.666265:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 190 00000100:00080000:2.0:1787784704.666269:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8951eff2f800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784704.666286:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c3270f00 x1874627750171392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784704.670014:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874627750171392:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787784704.670104:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787784704.670171:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c20de000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787784704.670177:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787784704.670181:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874627750171264:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787784704.670213:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874627750171264:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 4297us (4417us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784704.670226:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787784704.670250:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750171392 00000100:00100000:1.0:1787784704.670257:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750171392 00000100:00100000:1.0:1787784704.670292:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787784704.670298:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874627750171392:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1787784704.670316:0:7991:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787784704.670434:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874627750171392:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 133us (328us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784704.670441:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1787784704.670481:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951eff2f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784704.670486:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787784704.670489:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874627750171392:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787784704.670803:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5316940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750170112:0@lo:400:kworker.0 00010000:00080000:2.0:1787784704.670829:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f5317480 x1874627750170624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784704.670841:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750170624:0@lo:400:kworker.0 00000100:00100000:1.0:1787784704.686541:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874627750171008:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 35561us (35654us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784704.686574:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1787784704.686804:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951d87ad000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784704.686811:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787784704.686816:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750171008:0@lo:38:ptlrpcd_00_00.0 00000020:01000000:0.0:1787784705.541952:0:15117:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8950c3407c00 - data ffff8951f0b09ca8/ffff8950c340e000 00000020:01000000:0.0:1787784705.542155:0:15117:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8951c2e579c0 - data ffff8951f08bbbd0/ffff8951f04fa000 00010000:00010000:2.0:1787784705.542846:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787784705.547588:0:15117:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:1.0:1787784705.591572:0:15117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787784705.591580:0:15117:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1787784705.591596:0:15117:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8951cffc9a40 x1874627750169344/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787784713 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784705.591621:0:15117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787784705.599180:0:15117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787784705.599189:0:15117:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:1.0:1787784705.605456:0:15117:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787784705.605466:0:15117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787784705.605821:0:8914:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787784705.605827:0:8914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1787784705.605839:0:8914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787784705.606599:0:15117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787784705.606605:0:15117:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1787784705.606629:0:15117:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787784705.606632:0:15117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787784705.607121:0:9925:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787784705.607127:0:9925:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1787784705.607137:0:9925:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787784705.608546:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c89a 00000020:00000080:1.0:1787784705.608558:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951f81b1800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787784705.609176:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f81b1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787784705.611912:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c8af 00000020:00000080:1.0:1787784705.611925:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951f81b3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787784705.611945:0:15117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787784705.611951:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784705.611959:0:15117:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787784705.611963:0:15117:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8951f02d8000) has no exports 00000004:01000000:1.0:1787784705.612136:0:15117:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787784705.612145:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cce5 00000020:00000080:1.0:1787784705.612149:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951f67da000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787784705.612235:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f81b3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787784705.612276:0:15117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787784705.612280:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784705.612289:0:15117:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787784705.612292:0:15117:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8950c25b4d28) has no exports 00000020:00000080:1.0:1787784705.612298:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9ccde 00000020:00000080:1.0:1787784705.612312:0:15117:0:(genops.c:885:class_export_put()) final put ffff8950c34f8000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787784705.612629:0:15117:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787784705.612634:0:15117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787784705.612638:0:15117:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1787784705.612642:0:15117:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787784705.612645:0:15117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787784705.612675:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784705.612682:0:15117:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787784705.612688:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cba3 00000020:00000080:1.0:1787784705.612692:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951ff43b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787784705.612695:0:15117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787784705.612698:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784705.612702:0:15117:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787784705.612704:0:15117:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8951effecd28) has no exports 00000020:00000080:1.0:1787784705.612707:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cb9c 00000020:00000080:1.0:1787784705.612709:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951f67df000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787784705.612826:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f67da000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787784705.612833:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c34f8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787784705.612838:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c34fe000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787784705.612843:0:38:0:(genops.c:885:class_export_put()) final put ffff8951f6796000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787784705.612845:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f6796000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787784705.612849:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787784705.612927:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ff43b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787784705.612933:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f67df000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787784705.613441:0:15117:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787784705.613444:0:15117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787784705.613447:0:15117:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:1.0:1787784705.613450:0:15117:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787784705.613452:0:15117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787784705.613518:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784705.613568:0:15117:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787784705.613580:0:15117:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787784705.613585:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9ca53 00000020:00000080:1.0:1787784705.613591:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951f50db000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787784705.620320:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951f67dd000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787784705.620342:0:38:0:(genops.c:885:class_export_put()) final put ffff8951f67de000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787784705.620346:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f67de000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787784705.620372:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787784705.624374:0:15117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787784705.624403:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784705.624418:0:15117:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787784705.624424:0:15117:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8951fb38cd28) has no exports 00000020:00000080:1.0:1787784705.624434:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9ca4c 00000020:00000080:1.0:1787784705.624442:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951eff19000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787784705.625919:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f50db000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787784705.630899:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951eff19000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:3.0:1787784705.675004:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787784705.675014:0:8431:0:(genops.c:885:class_export_put()) final put ffff8950c20dc000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787784705.675040:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00000020:00000080:3.0:1787784705.675042:0:8431:0:(genops.c:885:class_export_put()) final put ffff8950c4024800/2e90d38f-8956-47bc-80da-c902c22ae09c 00000020:00000080:2.0:1787784705.675176:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c20dc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787784705.675222:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c4024800/2e90d38f-8956-47bc-80da-c902c22ae09c for lustre-OST0000 00000020:00000080:2.0:1787784705.675244:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c20dd000 for lustre-OST0000 00000020:00000080:2.0:1787784705.675249:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c4022800 for lustre-OST0000 00000001:00100000:3.0:1787784705.675366:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787784705.675369:0:9516:0:(genops.c:885:class_export_put()) final put ffff8950c1940000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787784705.675386:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00000020:00000080:3.0:1787784705.675389:0:9516:0:(genops.c:885:class_export_put()) final put ffff8951c2ce2800/2e90d38f-8956-47bc-80da-c902c22ae09c 00000020:00000080:2.0:1787784705.675423:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c1940000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787784705.675444:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c2ce2800/2e90d38f-8956-47bc-80da-c902c22ae09c for lustre-OST0001 00000020:00000080:2.0:1787784705.675457:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951ff43e800 for lustre-OST0001 00000020:00000080:2.0:1787784705.675462:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951c2ce6800 for lustre-OST0001 00000001:00100000:3.0:1787784705.676051:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787784705.676062:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1787784705.676067:0:7452:0:(genops.c:885:class_export_put()) final put ffff8951f5282000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787784705.676087:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1e5cc6ee-e7bb-4eda-bff3-48f824501258 00000001:00080000:3.0:1787784705.676092:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1787784705.676094:0:7452:0:(genops.c:885:class_export_put()) final put ffff8950c35a9000/1e5cc6ee-e7bb-4eda-bff3-48f824501258 00000001:00100000:3.0:1787784705.676100:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2e90d38f-8956-47bc-80da-c902c22ae09c 00000001:00080000:3.0:1787784705.676104:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1787784705.676106:0:7452:0:(genops.c:885:class_export_put()) final put ffff8951f53b4800/2e90d38f-8956-47bc-80da-c902c22ae09c 00000020:00000080:2.0:1787784705.678194:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f5282000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787784705.678278:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c35a9000/1e5cc6ee-e7bb-4eda-bff3-48f824501258 for lustre-MDT0001 00000020:00000080:2.0:1787784705.678301:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f53b4800/2e90d38f-8956-47bc-80da-c902c22ae09c for lustre-MDT0001 00000020:00000080:2.0:1787784705.678325:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951f5287800 for lustre-MDT0001 00000020:00000080:2.0:1787784705.678330:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c35ac000 for lustre-MDT0001 00000020:00000080:2.0:1787784705.678349:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff895201ca3000 for lustre-MDT0001 00010000:01000000:2.0:1787784705.684823:0:15117:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787784705.684831:0:15117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787784705.684835:0:15117:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1787784705.684843:0:15117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787784705.684895:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784705.684908:0:15117:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787784705.684935:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784705.684939:0:15117:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787784705.684944:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951f81b6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787784705.684949:0:15117:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f81b6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787784705.684956:0:15117:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787784705.685117:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951eff1f800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787784705.685124:0:38:0:(genops.c:885:class_export_put()) final put ffff8951eff18000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787784705.685126:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951eff18000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787784705.685134:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787784705.685265:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c8b6 00000020:00000080:2.0:1787784705.685273:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951f81b5800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787784705.685286:0:15117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787784705.685291:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784705.685296:0:15117:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787784705.685299:0:15117:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8951f02db370) has no exports 00000020:00000080:2.0:1787784705.685319:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784705.685322:0:15117:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787784705.685328:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c8bd 00000020:00000080:2.0:1787784705.685331:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951f81b3800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787784705.685340:0:15117:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951d08ed800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787784705.685343:0:15117:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951d08ed800 3 00000020:01000004:2.0:1787784705.685346:0:15117:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8951d08ed800 from lustre-MDT0000 00000020:00000080:2.0:1787784705.685363:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784705.685367:0:15117:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787784705.685369:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951f81b1000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787784705.685371:0:15117:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f81b1000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787784705.685377:0:15117:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787784705.685406:0:15117:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787784705.685421:0:15117:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787784705.685423:0:15117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787784705.685426:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784705.685428:0:15117:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787784705.685434:0:15117:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8951fa9c0800 ee96db03-39cf-4d18-a974-880a628ded6e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787784705.685440:0:15117:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8951cfef4d28) has exports, disconnecting them 00000020:00080000:2.0:1787784705.685444:0:15117:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8951fa9c0800), last request at 1787784429 00000020:00000080:2.0:1787784705.685457:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c85b 00000020:00010000:2.0:1787784705.685461:0:15117:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8951fa9c0800: total 2 00000100:00080000:2.0:1787784705.685464:0:15117:0:(import.c:65:import_set_state_nolock()) ffff8951fa9c7800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1787784705.687090:0:6509:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8951fa9c0800: total 2 00010000:00010000:3.0:1787784705.687154:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8951fa9c0800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787784705.687188:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c13fe200/0x88ace7295d9c965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9c95e expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784705.687222:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c13fe600/0x88ace7295d9c957 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9c950 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784705.687236:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c151f800/0x88ace7295d9cc7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9cc75 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784705.687249:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d35200/0x88ace7295d9cd5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9cd55 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784705.687260:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1628200/0x88ace7295d9cd6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9cd63 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784705.687271:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff895201c5a600/0x88ace7295d9cda9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9cda2 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784705.687280:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1628000/0x88ace7295d9cd78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9cd71 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784705.687290:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df603000/0x88ace7295d9d034 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9d02d expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784705.687300:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df602600/0x88ace7295d9cdda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9cdd3 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784705.687310:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34200/0x88ace7295d9cd94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9cd8d expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784705.687321:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1628e00/0x88ace7295d9d042 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9d03b expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784705.687343:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3712800/0x88ace7295d9d050 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9d049 expref: 5 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784705.687355:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34600/0x88ace7295d9cd86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9cd7f expref: 4 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784705.687365:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8951fa9c0800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1787784705.687383:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784705.687385:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784705.687387:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787784705.687400:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f81b5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787784705.687408:0:38:0:(genops.c:885:class_export_put()) final put ffff8951f81b2800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787784705.687411:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f81b2800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787784705.687416:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787784705.687457:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f81b3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1787784705.689174:0:15117:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951fa9c0800): rc 0 00000020:00000080:2.0:1787784705.689181:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951fa9c0800/ee96db03-39cf-4d18-a974-880a628ded6e 00000020:00080000:2.0:1787784705.689204:0:15117:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8951cfef4d28) has no exports 00000100:00100000:3.0:1787784705.689345:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8951fa955600:6516] 2 exiting: rc = 0 00000020:00000080:3.0:1787784705.689441:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fa9c0800/ee96db03-39cf-4d18-a974-880a628ded6e for MGS 00000020:00000080:3.0:1787784705.689489:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951fa9c7800 for MGS 00000100:00100000:0.0:1787784705.690440:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8951fa955800:6514] 1 exiting: rc = 0 00000100:00100000:1.0:1787784705.691292:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8951fa955c00:6513] 0 exiting: rc = 1 00000100:00100000:2.0:1787784705.691437:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691447:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691454:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691459:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691465:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691470:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691488:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691496:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691500:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691507:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691513:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691518:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691524:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691540:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691547:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691554:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691560:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691566:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691572:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691577:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691594:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691600:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691606:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691612:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691618:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691623:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691629:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691634:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691640:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691645:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691651:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691657:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691662:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691668:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691674:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691679:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691685:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691690:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691695:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691701:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691706:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691711:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691717:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691723:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691729:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691735:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691741:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691747:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691753:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691760:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691784:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691791:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691798:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691805:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691810:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691823:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691828:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691833:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691839:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691845:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691850:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691855:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691860:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784705.691866:0:15117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1787784705.705045:0:15117:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8950c3407cc0 - data ffff8950c1d9c360/ffff8950c340d000 00000020:01000000:2.0:1787784705.705213:0:15117:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8951d003f7e0 - data ffff8951e0efd000/ffff8951cfee8c00 00000020:00000080:2.0:1787784705.705716:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c83f 00000020:00000080:2.0:1787784705.705726:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951c85a6000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787784705.705749:0:15117:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951d08ed800 from MGS, refs=2 00000020:01000004:2.0:1787784705.705753:0:15117:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951d08ed800 2 00000020:01000004:2.0:1787784705.705756:0:15117:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8951d08ed800 from MGS 00000020:00000080:2.0:1787784705.705801:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784705.705808:0:15117:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787784705.705811:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951c85a1800/MGS 00000020:00000080:2.0:1787784705.705814:0:15117:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c85a1800/MGS for MGS 00000020:01000000:2.0:1787784705.705821:0:15117:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787784705.705899:0:15117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787784705.705903:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784705.705910:0:15117:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787784705.705917:0:15117:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8951fb22a800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787784705.705924:0:15117:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8951ebd53370) has exports, disconnecting them 00000020:00080000:2.0:1787784705.705929:0:15117:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8951fb22a800), last request at 1787784429 00000020:00000080:2.0:1787784705.705933:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c90a 00000020:00080000:2.0:1787784705.705943:0:15117:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951fb22a800): rc 0 00000020:00000080:2.0:1787784705.705948:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951fb22a800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787784705.706607:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c85a6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787784705.706620:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fb22a800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787784705.789878:0:15117:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787784705.789888:0:15117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787784705.789893:0:15117:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787784705.789901:0:15117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787784705.790120:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784705.790129:0:15117:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787784705.790136:0:15117:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951d08ed800 1 00000020:00000080:3.0:1787784705.790143:0:15117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c831 00000020:00000080:3.0:1787784705.790164:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951c85a3000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787784705.790171:0:15117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787784705.790175:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784705.790180:0:15117:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787784705.790184:0:15117:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8951ebd519b8) has no exports 00000020:00000080:1.0:1787784705.792522:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951d87a8800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787784705.792536:0:15021:0:(genops.c:885:class_export_put()) final put ffff8951d87ad800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787784705.792540:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951d87ad800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787784705.792551:0:15021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787784705.792622:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c85a3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787784705.908213:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784705.908226:0:15117:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787784705.908231:0:15117:0:(genops.c:885:class_export_put()) final put ffff8951d08e9800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787784705.908236:0:15117:0:(genops.c:844:class_export_destroy()) destroying export ffff8951d08e9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787784705.908242:0:15117:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787784705.908354:0:15117:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8951d08eb800 00000020:02000400:0.0:1787784705.908415:0:15117:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787784706.567089:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784707.595306:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784708.614172:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784709.256159:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3271e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750171520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787784709.256229:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784709.256587:0:10759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750171520 00000100:00100000:0.0:1787784709.256596:0:10759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750171520 00000100:00100000:0.0:1787784709.256670:0:10759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787784709.256680:0:10759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750171520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784709.256718:0:10759:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787784709.256787:0:10759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750171520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784709.256794:0:10759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787784709.256846:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3271e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750171520:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787784709.257217:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787784709.638030:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784709.766140:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784709.766167:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750171648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784709.766235:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784709.766305:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750171648 00000100:00100000:0.0:1787784709.766313:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750171648 00000100:00100000:0.0:1787784709.766359:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787784709.766368:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750171648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787784709.766402:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787784709.766444:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750171648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784709.766451:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787784709.766492:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750171648:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787784709.766613:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784709.766901:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750171776:0@lo:400:kworker.0 00000400:00000100:1.0:1787784709.766927:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874627750171776 offset 0 length 224: 4 00000100:00080000:0.0:1787784709.766972:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784709.766976:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787784709.766979:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951cfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784709.766984:0:15021:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 444 00000100:00080000:0.0:1787784709.766988:0:15021:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787784709.766993:0:15021:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8951cfe96800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784709.767015:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47c780 x1874627750171904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784709.767032:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784709.767036:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787784709.767048:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951eff2f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784709.767052:0:15021:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 444 00000100:00080000:0.0:1787784709.767055:0:15021:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787784709.767058:0:15021:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8951eff2f800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784709.767070:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47f480 x1874627750172032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784709.767079:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784709.767082:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787784709.767084:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8950c20de000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784709.767092:0:15021:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 444 00000100:00080000:0.0:1787784709.767095:0:15021:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787784709.767098:0:15021:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8950c20de000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784709.767108:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47e580 x1874627750172160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784709.767140:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784709.767143:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787784709.767145:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951d87ad000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784709.767148:0:15021:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 444 00000100:00080000:0.0:1787784709.767150:0:15021:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787784709.767153:0:15021:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8951d87ad000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784709.767164:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47cb40 x1874627750172544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784709.767217:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750172672:0@lo:400:kworker.0 00000100:00100000:3.0:1787784709.767249:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784709.767282:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750172672 00000100:00100000:3.0:1787784709.767286:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750172672 00000100:00100000:3.0:1787784709.767319:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1787784709.767326:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750172672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784709.767360:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750172672:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784709.767367:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00080000:3.0:1787784709.767384:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787784709.767401:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8951ff47c000 x1874627750172672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784709.767410:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750172672:0@lo:400:kworker.0 00000100:00100000:1.0:1787784709.773049:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750172288:0@lo:400:kworker.0 00000100:00100000:1.0:1787784709.773124:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784709.773157:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784709.773164:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750172416:0@lo:400:kworker.0 00000100:00100000:1.0:1787784709.773187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784709.773211:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750171904:0@lo:38:kworker.0 00000100:00100000:1.0:1787784709.773236:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784709.773254:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874627750172032:0@lo:38:kworker.0 00000100:00100000:1.0:1787784709.773275:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784709.773289:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874627750172160:0@lo:38:kworker.0 00000100:00100000:1.0:1787784709.773306:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784709.773320:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750172544:0@lo:38:kworker.0 00000100:00100000:1.0:1787784709.773339:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784709.773368:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750172288 00000100:00100000:1.0:1787784709.773375:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750172288 00000100:00100000:1.0:1787784709.773432:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750172032 00000100:00100000:1.0:1787784709.773436:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750172032 00000100:00100000:1.0:1787784709.773448:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750172160 00000100:00100000:1.0:1787784709.773451:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750172160 00000100:00100000:1.0:1787784709.773457:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750172544 00000100:00100000:1.0:1787784709.773458:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750172544 00000100:00100000:1.0:1787784709.773469:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1787784709.773477:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750172288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784709.773525:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750172288:12345-0@lo:400:kworker.0 Request processed in 49us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784709.773532:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1787784709.773548:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787784709.773552:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874627750172032:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787784709.773571:0:6523:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787784709.773678:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874627750172032:12345-0@lo:38:kworker.0 Request processed in 48us (326us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784709.773685:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787784709.773754:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787784709.773759:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874627750172160:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787784709.773786:0:6523:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787784709.773809:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874627750172160:12345-0@lo:38:kworker.0 Request processed in 51us (503us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784709.773814:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787784709.773824:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787784709.773828:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874627750172544:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787784709.773836:0:6523:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787784709.773864:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874627750172544:12345-0@lo:38:kworker.0 Request processed in 35us (523us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784709.773869:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787784709.773886:0:8916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750172416 00000100:00100000:1.0:1787784709.773889:0:8916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750172416 00000100:00100000:1.0:1787784709.773921:0:8916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787784709.773928:0:8916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3413c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750172416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784709.773955:0:8916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3413c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750172416:12345-0@lo:400:kworker.0 Request processed in 29us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784709.773962:0:8916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787784709.773977:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750171904 00000100:00100000:1.0:1787784709.773981:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750171904 00000100:00100000:1.0:1787784709.773998:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787784709.774003:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750171904:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787784709.774013:0:6527:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787784709.774048:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750171904:12345-0@lo:38:kworker.0 Request processed in 34us (801us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784709.774054:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787784709.774097:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750172416:0@lo:400:kworker.0 00010000:00080000:1.0:1787784709.774109:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8951ff47cf00 x1874627750172288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784709.774118:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750172288:0@lo:400:kworker.0 00000100:00080000:1.0:1787784709.774156:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784709.774162:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787784709.774166:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750171904:0@lo:38:kworker.0 00000100:00080000:1.0:1787784709.774181:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951eff2f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784709.774185:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787784709.774188:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874627750172032:0@lo:38:kworker.0 00000100:00080000:1.0:1787784709.774194:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c20de000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784709.774198:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787784709.774200:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874627750172160:0@lo:38:kworker.0 00000100:00080000:1.0:1787784709.774207:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951d87ad000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784709.774211:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787784709.774213:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750172544:0@lo:38:kworker.0 00000100:00080000:1.0:1787784709.774241:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000004:2.0:1787784709.884394:0:15318:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787784709.899897:0:15318:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1787784709.899945:0:15318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.899956:0:15318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.899961:0:15318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.899965:0:15318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.900032:0:15318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787784709.900047:0:15318:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787784709.900073:0:15318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784709.900077:0:15318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787784709.900082:0:15318:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787784709.900088:0:15318:0:(import.c:65:import_set_state_nolock()) ffff8951eff2f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787784709.900093:0:15318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784709.900094:0:15318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787784709.900097:0:15318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787784709.900948:0:15318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.900959:0:15318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.900965:0:15318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.900989:0:15318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.901104:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784709.901112:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.901119:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784709.901122:0:10397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.901130:0:10397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784709.901137:0:10397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784709.901155:0:10397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784709.901157:0:10397:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787784709.901159:0:10397:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787784709.901195:0:10397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.901202:0:10397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787784709.901269:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750172800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784709.901337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784709.901421:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.901429:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9cd8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cd94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.901449:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784709.901452:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.901458:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030e00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784709.901461:0:10397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.901468:0:10397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784709.901474:0:10397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784709.901479:0:10397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784709.901481:0:10397:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1787784709.901495:0:10397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.901506:0:10397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784709.901520:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784709.901527:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750172800 00010000:00010000:0.0:1787784709.901527:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784709.901528:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784709.901530:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784709.901534:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750172800 00000100:00100000:0.0:1787784709.901542:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784709.901551:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750172928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784709.901577:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784709.901586:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750172928 00000100:00100000:1.0:1787784709.901589:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750172928 00000100:00100000:1.0:1787784709.901607:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787784709.901624:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1874627750172800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784709.901630:0:15318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00020000:1.0:1787784709.901631:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787784709 with bad export cookie 615531290625165403 00010000:00010000:2.0:1787784709.901635:0:15318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0030e00/0x88ace7295d9cda2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cda9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901651:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784709.901660:0:15318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901666:0:15318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901672:0:15318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901678:0:15318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901691:0:15318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784709.901697:0:15318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901703:0:15318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901709:0:15318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901721:0:15318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901732:0:15318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787784709.901737:0:15318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151fa00/0x88ace7295d9c95e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901742:0:15318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151fa00/0x88ace7295d9c95e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901747:0:15318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151fa00/0x88ace7295d9c95e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901752:0:15318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951c151fa00/0x88ace7295d9c95e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901760:0:15318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1787784709.901763:0:15318:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1787784709.901785:0:15318:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:2.0:1787784709.901809:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787784709.901814:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901821:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f200 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784709.901824:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901831:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784709.901848:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784709.901854:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787784709.901857:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787784709.901858:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787784709.901873:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901878:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784709.901889:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901896:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c151f200/0x88ace7295d9cc75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9cc7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901909:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784709.901912:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901918:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784709.901921:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901928:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784709.901934:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784709.901950:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787784709.901952:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787784709.901954:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787784709.901968:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.901974:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787784709.902035:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784709.902053:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750173184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784709.902082:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784709.902152:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787784709.902158:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1874627750172928:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787784709.902163:0:8452:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787784709 with bad export cookie 615531290625165403 00000100:00100000:0.0:1787784709.902201:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1874627750172928:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (623us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787784709.902208:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787784709.902223:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750173184 00000100:00100000:0.0:1787784709.902226:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750173184 00000100:00100000:0.0:1787784709.902239:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787784709.902243:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d24ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1874627750173184:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787784709.902246:0:8452:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787784709 with bad export cookie 615531290625165403 00000100:00100000:0.0:1787784709.902277:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d24ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1874627750173184:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (194us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787784709.902282:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1787784709.902296:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784709.902301:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c151fa00/0x88ace7295d9c95e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.902319:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151fa00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784709.902322:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c151fa00/0x88ace7295d9c95e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.902328:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c151fa00/0x88ace7295d9c95e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784709.902335:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c151fa00/0x88ace7295d9c95e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784709.902340:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784709.902342:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787784709.902344:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787784709.902358:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c151fa00/0x88ace7295d9c95e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.902364:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784709.902371:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c151fa00/0x88ace7295d9c95e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.902378:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c151fa00/0x88ace7295d9c95e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9c965 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784709.902389:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784709.902391:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784709.902392:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784709.902398:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784709.902406:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750173312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784709.902431:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784709.902462:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750173056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784709.902484:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787784709.902503:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787784709.902507:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8951faa01800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787784709.902511:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.141@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1787784709.902581:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.902589:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9d049 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9d050 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784709.902599:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784709.902601:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784709.902603:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787784709.902617:0:15318:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1787784709.902621:0:15318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1787784709.902626:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784709.902631:0:15318:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787784709.902636:0:15318:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8951ff438000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787784709.902643:0:15318:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8950c20d9800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787784709.902648:0:15318:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8951ebd50000) has exports, disconnecting them 00000020:00080000:2.0:1787784709.902652:0:15318:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8951ff438000), last request at 1787784709 00000020:00000080:2.0:1787784709.902659:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cc3d 00000100:00080000:2.0:1787784709.902673:0:15318:0:(import.c:65:import_set_state_nolock()) ffff8951ff43a800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787784709.902753:0:15318:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951ff438000): rc 0 00000020:00000080:2.0:1787784709.902755:0:15318:0:(genops.c:885:class_export_put()) final put ffff8951ff438000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1787784709.902796:0:15318:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8950c20d9800), last request at 1787784709 00000020:00000080:2.0:1787784709.902806:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cb17 00000100:00080000:2.0:1787784709.902812:0:15318:0:(import.c:65:import_set_state_nolock()) ffff8950c20dc800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787784709.903058:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787784709.903440:0:15318:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8950c20d9800): rc 0 00000020:00000080:2.0:1787784709.903443:0:15318:0:(genops.c:885:class_export_put()) final put ffff8950c20d9800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1787784709.903452:0:15318:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb77a01977ae0 00000100:00080000:2.0:1787784709.903473:0:15318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784709.903477:0:15318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1787784709.904256:0:15318:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787784709.904264:0:15318:0:(import.c:65:import_set_state_nolock()) ffff8951cfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1787784709.904456:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784709.904559:0:15318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787784709.904563:0:15318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1787784709.904582:0:15318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787784709.904640:0:15318:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787784709.904663:0:15318:0:(import.c:65:import_set_state_nolock()) ffff8951f67db000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787784709.904686:0:15318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787784709.904689:0:15318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1787784709.904698:0:15318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787784709.904755:0:15318:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787784709.904763:0:15318:0:(import.c:65:import_set_state_nolock()) ffff8951f6790800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787784709.904812:0:15318:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8951ebd50000) has no exports 00000100:00100000:1.0:1787784709.911534:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750173440:0@lo:9:umount.0 00000100:00100000:1.0:1787784709.911740:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784709.911815:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750173440 00000100:00100000:2.0:1787784709.911824:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750173440 00000100:00100000:2.0:1787784709.911880:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787784709.911889:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874627750173440:12345-0@lo:9:umount.0 00000100:00100000:1.0:1787784709.911908:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3271680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750173568:0@lo:9:umount.0 00000020:00000080:2.0:1787784709.911916:0:8437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cb72 00000100:00080000:2.0:1787784709.911926:0:8437:0:(import.c:65:import_set_state_nolock()) ffff8950c20da800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787784709.911934:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:2.0:1787784709.911968:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1787784709.911974:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750173312 00000100:00100000:1.0:1787784709.911978:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750173312 00000100:00100000:1.0:1787784709.911992:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750173056 00000100:00100000:1.0:1787784709.911995:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750173056 00000100:00100000:1.0:1787784709.912004:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787784709.912023:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1874627750173312:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787784709.912029:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787784709 with bad export cookie 615531290625165403 00000100:00100000:1.0:1787784709.912083:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1874627750173312:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (9651us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787784709.912091:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787784709.912107:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787784709.912108:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3643:x1874627750173440:12345-0@lo:9:umount.0 Request processed in 221us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784709.912111:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1874627750173056:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787784709.912115:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787784709 with bad export cookie 615531290625165403 00000100:00100000:2.0:1787784709.912121:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787784709.912131:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750173568 00000100:00100000:2.0:1787784709.912134:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750173568 00000100:00100000:1.0:1787784709.912138:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1874627750173056:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (9654us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787784709.912144:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787784709.912154:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787784709.912160:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbf0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874627750173568:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787784709.912169:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ff438000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1787784709.912171:0:8437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cca6 00000100:00080000:2.0:1787784709.912176:0:8437:0:(import.c:65:import_set_state_nolock()) ffff8951eff1a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787784709.912196:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000020:00000080:1.0:1787784709.912212:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c20d9800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1787784709.912237:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951ff43a800 for lustre-MDT0001 00000020:00000080:1.0:1787784709.912242:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c20dc800 for lustre-MDT0001 00000100:00100000:2.0:1787784709.912264:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbf0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3643:x1874627750173568:12345-0@lo:9:umount.0 Request processed in 104us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784709.912270:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1787784709.912285:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:3.0:1787784709.912854:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784709.913239:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784709.914637:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:3.0:1787784709.920844:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787784709.926657:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.141@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787784709.926664:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787784709.926674:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951ff47ed00 x1874627750171776/t0(0) o400->MGC192.168.202.141@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787784725 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784709.926946:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951ff47f0c0 x1874627750172800/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787784725 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784709.926959:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951ff47e940 x1874627750172928/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787784725 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784709.926968:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8950c3273480 x1874627750173184/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787784725 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784709.926974:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951ff47cb40 x1874627750173312/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787784725 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784709.926982:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8950c32703c0 x1874627750173056/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787784725 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787784709.926999:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787784709.927003:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787784709.927004:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787784709.927008:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8951faa01800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784709.927013:0:3645:0:(import.c:510:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 169 00000100:00080000:0.0:1787784709.927022:0:3645:0:(import.c:624:import_select_connection()) MGC192.168.202.141@tcp: import ffff8951faa01800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784709.927068:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47c780 x1874627750173696/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784709.927108:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8951faa01800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:2.0:1787784709.927137:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750172800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784709.927146:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750171776:0@lo:400:kworker.0 00000100:00100000:2.0:1787784709.927177:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee96db03-39cf-4d18-a974-880a628ded6e:3647:1874627750173184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784709.927233:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750173056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784709.927238:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee96db03-39cf-4d18-a974-880a628ded6e:3645:1874627750172928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784709.927854:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee96db03-39cf-4d18-a974-880a628ded6e:3643:1874627750173696:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1787784709.927904:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874627750173696 offset 0 length 520: 4 00000100:00080000:0.0:1787784709.927962:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f67db000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787784709.927979:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787784709.927982:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787784709.927985:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750173440:0@lo:9:umount.0 00000100:00080000:0.0:1787784709.927999:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f6790800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787784709.928010:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787784709.928012:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787784709.928014:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3271680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750173568:0@lo:9:umount.0 00000400:00000100:0.0:1787784709.928071:0:6506:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874627750172800 offset 224 length 224: 4 00000100:00100000:0.0:1787784709.928083:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1874627750172800:12345-0@lo:103:ldlm_bl.0 Request processed in 26459us (26747us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787784709.928093:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787784709.928381:0:3646:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8951faa01800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1787784709.928484:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee96db03-39cf-4d18-a974-880a628ded6e:3646:1874627750173312:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787784709.935086:0:15318:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8951ebd50000) has no exports 00000020:01000000:1.0:1787784709.970458:0:15318:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8950c3407a20 - data ffff8950c1d93ca8/ffff8950c340d400 00000020:01000000:1.0:1787784709.970627:0:15318:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8951f525b120 - data ffff8951f0892948/ffff8951f527ec00 00000001:00000004:1.0:1787784709.990092:0:15318:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1787784710.025980:0:15318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784710.025989:0:15318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787784710.025996:0:15318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787784710.027531:0:15318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787784710.027538:0:15318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787784710.027559:0:15318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787784710.027562:0:15318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787784710.027850:0:8910:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787784710.027856:0:8910:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1787784710.027867:0:8910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787784710.028845:0:15318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787784710.028851:0:15318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787784710.028876:0:15318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787784710.028879:0:15318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787784710.029144:0:9918:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787784710.029149:0:9918:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1787784710.029162:0:9918:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787784710.034666:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c981 00000020:00000080:2.0:1787784710.034679:0:15318:0:(genops.c:885:class_export_put()) final put ffff8951fb228800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787784710.035120:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fb228800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787784710.036166:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c996 00000020:00000080:3.0:1787784710.036179:0:15318:0:(genops.c:885:class_export_put()) final put ffff895201d19800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787784710.036227:0:15318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787784710.036233:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784710.036242:0:15318:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787784710.036246:0:15318:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8951ebd54d28) has no exports 00000004:01000000:3.0:1787784710.036475:0:15318:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787784710.036484:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cc9f 00000020:00000080:3.0:1787784710.036489:0:15318:0:(genops.c:885:class_export_put()) final put ffff8951f53b7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787784710.036827:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff895201d19800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787784710.036951:0:15318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787784710.036955:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784710.036963:0:15318:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787784710.036966:0:15318:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8950c25b3370) has no exports 00000020:00000080:3.0:1787784710.036972:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cc98 00000020:00000080:3.0:1787784710.036976:0:15318:0:(genops.c:885:class_export_put()) final put ffff8951f6797800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787784710.037240:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f53b7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:3.0:1787784710.037671:0:15318:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787784710.037676:0:15318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787784710.037681:0:15318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1787784710.037687:0:15318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787784710.037689:0:15318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787784710.038093:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f6797800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787784710.038194:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784710.038204:0:15318:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787784710.038211:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cb5d 00000020:00000080:3.0:1787784710.038218:0:15318:0:(genops.c:885:class_export_put()) final put ffff895201ca7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787784710.038477:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951f6790800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787784710.038484:0:38:0:(genops.c:885:class_export_put()) final put ffff8951f53b3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787784710.038487:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f53b3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787784710.038491:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787784710.038661:0:15318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787784710.038666:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784710.038672:0:15318:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787784710.038676:0:15318:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8951effeb370) has no exports 00000020:00000080:3.0:1787784710.038682:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cb56 00000020:00000080:3.0:1787784710.038695:0:15318:0:(genops.c:885:class_export_put()) final put ffff8951f67dd800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1787784710.039096:0:15318:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787784710.039100:0:15318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787784710.039103:0:15318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1787784710.039107:0:15318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787784710.039110:0:15318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787784710.039136:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784710.039142:0:15318:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787784710.039154:0:15318:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787784710.039160:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c9b9 00000020:00000080:3.0:1787784710.039165:0:15318:0:(genops.c:885:class_export_put()) final put ffff8951fb22c800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787784710.039168:0:15318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787784710.039171:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784710.039174:0:15318:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787784710.039177:0:15318:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8951fb38b370) has no exports 00000020:00000080:3.0:1787784710.039181:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c9b2 00000020:00000080:3.0:1787784710.039184:0:15318:0:(genops.c:885:class_export_put()) final put ffff8951cfe90000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787784710.039469:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff895201ca7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787784710.039477:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f67dd800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787784710.039482:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951f67db000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787784710.039486:0:38:0:(genops.c:885:class_export_put()) final put ffff8951ebd60000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787784710.039489:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ebd60000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1787784710.039492:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787784710.039544:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fb22c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787784710.039549:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951cfe90000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787784710.040825:0:15318:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1787784710.040831:0:15318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784710.040835:0:15318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1787784710.040841:0:15318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787784710.040881:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784710.040890:0:15318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787784710.040916:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784710.040919:0:15318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787784710.040923:0:15318:0:(genops.c:885:class_export_put()) final put ffff8951d87ae000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787784710.040927:0:15318:0:(genops.c:844:class_export_destroy()) destroying export ffff8951d87ae000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787784710.040932:0:15318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787784710.041093:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c99d 00000020:00000080:2.0:1787784710.041099:0:15318:0:(genops.c:885:class_export_put()) final put ffff895201d19000/lustre-MDD0001_UUID 00000020:01000000:2.0:1787784710.041105:0:15318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1787784710.041108:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784710.041112:0:15318:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787784710.041114:0:15318:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff895201d0b370) has no exports 00000020:00000080:2.0:1787784710.041132:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784710.041135:0:15318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1787784710.041138:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c9a4 00000020:00000080:2.0:1787784710.041141:0:15318:0:(genops.c:885:class_export_put()) final put ffff895201d1c800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1787784710.041147:0:15318:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951cfe95800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1787784710.041150:0:15318:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951cfe95800 2 00000020:01000004:2.0:1787784710.041153:0:15318:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8951cfe95800 from lustre-MDT0001 00000020:00000080:2.0:1787784710.041170:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784710.041173:0:15318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1787784710.041175:0:15318:0:(genops.c:885:class_export_put()) final put ffff8951fb22f800/lustre-MDT0001_UUID 00000020:00000080:2.0:1787784710.041177:0:15318:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fb22f800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1787784710.041194:0:15318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1787784710.041232:0:15318:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1787784710.041236:0:15318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1787784710.041239:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784710.041242:0:15318:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787784710.041248:0:15318:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8951eff2d000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787784710.041253:0:15318:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8951effe8000) has exports, disconnecting them 00000020:00080000:2.0:1787784710.041257:0:15318:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8951eff2d000), last request at 1787784449 00000020:00000080:2.0:1787784710.041261:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c9f8 00000020:00080000:2.0:1787784710.041273:0:15318:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951eff2d000): rc 0 00000020:00000080:2.0:1787784710.041276:0:15318:0:(genops.c:885:class_export_put()) final put ffff8951eff2d000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787784710.042210:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951cfe96800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787784710.042221:0:38:0:(genops.c:885:class_export_put()) final put ffff895201cf0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787784710.042224:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff895201cf0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787784710.042229:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787784710.042331:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff895201d19000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787784710.042335:0:38:0:(genops.c:885:class_export_put()) final put ffff8951fb229800/lustre-MDD0001_UUID 00000020:00000080:1.0:1787784710.042337:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fb229800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787784710.042340:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787784710.042556:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff895201d1c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787784710.042561:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951eff2d000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787784710.070003:0:15318:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787784710.070012:0:15318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784710.070017:0:15318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787784710.070026:0:15318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787784710.070267:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784710.070278:0:15318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787784710.070285:0:15318:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951cfe95800 1 00000020:00000080:2.0:1787784710.070291:0:15318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c934 00000020:00000080:2.0:1787784710.070300:0:15318:0:(genops.c:885:class_export_put()) final put ffff8951ebd67000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787784710.070663:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951eff2f800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787784710.070672:0:38:0:(genops.c:885:class_export_put()) final put ffff895201ca3800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1787784710.070676:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff895201ca3800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1787784710.070688:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:2.0:1787784710.070889:0:15318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787784710.070894:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784710.070900:0:15318:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787784710.070903:0:15318:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8951fb3899b8) has no exports 00000020:00000080:1.0:1787784710.077172:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ebd67000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787784710.130174:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784710.130187:0:15318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787784710.130192:0:15318:0:(genops.c:885:class_export_put()) final put ffff8951cfe93000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787784710.130197:0:15318:0:(genops.c:844:class_export_destroy()) destroying export ffff8951cfe93000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787784710.130207:0:15318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787784710.130325:0:15318:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8951cfe95000 00000020:01000000:3.0:1787784710.130344:0:15318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787784710.130348:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784710.130352:0:15318:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787784710.130357:0:15318:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8951f02dcd28) has no exports 00000100:00100000:1.0:1787784710.130685:0:6523:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8951fa970c00:6523] 2 exiting: rc = 0 00000100:00100000:1.0:1787784710.130829:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8951ebd18e00:6522] 1 exiting: rc = 0 00000100:00100000:1.0:1787784710.130919:0:7991:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8951df6ec000:7991] 3 exiting: rc = 0 00000100:00100000:1.0:1787784710.130979:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8951e0bd3400:6521] 0 exiting: rc = 1 00000100:00100000:2.0:1787784710.131178:0:11332:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8950c23da200:11332] 4 exiting: rc = 0 00000100:00100000:0.0:1787784710.131315:0:14535:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff8951c7ea2200:14535] 5 exiting: rc = 0 00000100:00100000:3.0:1787784710.133206:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133218:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133224:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133229:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133235:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133240:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133262:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133268:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133274:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133279:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133285:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133290:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133294:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133299:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133303:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133308:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133312:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133317:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133322:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133327:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133332:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133338:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133343:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133349:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133355:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133377:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133384:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133388:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133393:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133484:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133490:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133495:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133500:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133505:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133510:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133515:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133520:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133525:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133529:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133534:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133539:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133553:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133558:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133564:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133569:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133575:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133579:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133585:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133590:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133595:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133600:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133605:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133611:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133616:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133621:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133627:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133632:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133638:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133643:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133649:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133655:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133661:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133665:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.133670:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784710.140334:0:14224:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8950c33c3e00:14224] 2 exiting: rc = 0 00000100:00100000:0.0:1787784710.140458:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8951faa22200:6524] 0 exiting: rc = 1 00000100:00100000:2.0:1787784710.141569:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8951fa970400:6525] 1 exiting: rc = 0 00000100:00100000:2.0:1787784710.141652:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141661:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141668:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141674:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141695:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141701:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141711:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141719:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141726:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141732:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141737:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141743:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141748:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141756:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141761:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141782:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141787:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141792:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141797:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141801:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141806:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141810:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141815:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141866:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141870:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141875:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141879:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141884:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141888:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141893:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141898:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141902:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141906:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141911:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141915:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141919:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141924:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141928:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141932:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141944:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141948:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141952:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141957:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141962:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141967:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141972:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141976:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141981:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141986:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141990:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141995:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.141999:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.142005:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.142010:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.142015:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.142019:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.142024:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.142028:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.142032:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.142046:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.142051:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.142057:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.142062:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.142066:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784710.142530:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8951c6064200:6527] 1 exiting: rc = 0 00000100:00100000:1.0:1787784710.142609:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8951df666800:6526] 0 exiting: rc = 1 00000100:00100000:2.0:1787784710.144161:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144172:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144179:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144199:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144205:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144210:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144216:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144223:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144230:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144235:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144253:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144259:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144265:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144271:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144277:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144301:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144308:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144313:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144318:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144324:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144329:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144335:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144341:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144347:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144357:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144363:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144370:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144391:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144399:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144405:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144410:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144417:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144422:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144428:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144434:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144438:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144444:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144449:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144454:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144473:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144480:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144485:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144491:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144497:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144503:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144517:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144523:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144528:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144533:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144538:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144543:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144561:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144567:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144572:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144577:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144582:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144587:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144592:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144597:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144602:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144608:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144613:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144619:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.144632:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784710.152677:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8951c6065800:6528] 0 exiting: rc = 1 00000100:00100000:0.0:1787784710.152881:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8951c6064a00:6529] 1 exiting: rc = 0 00000100:00100000:2.0:1787784710.153209:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153217:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153223:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153227:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153233:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153238:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153244:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153249:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153253:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153258:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153262:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153268:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153273:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153278:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153284:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153289:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153309:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153313:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153318:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153323:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153327:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153332:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153337:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153342:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153347:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153353:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153358:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153363:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153367:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153372:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153377:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153382:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153387:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153393:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153398:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153404:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153409:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153414:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153420:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153425:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153430:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153435:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153440:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153445:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153450:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153455:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153460:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153464:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153470:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153475:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153729:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153741:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153744:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153748:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153752:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153755:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153758:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153761:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153764:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153788:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153795:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153801:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153806:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.153811:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784710.154137:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8951e205d400:6531] 1 exiting: rc = 0 00000100:00100000:3.0:1787784710.154200:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8951c6065e00:6530] 0 exiting: rc = 1 00000100:00100000:2.0:1787784710.154277:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154283:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154288:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154293:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154298:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154303:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154308:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154313:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154319:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154324:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154330:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154334:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154338:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154342:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154345:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154349:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154352:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154355:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154358:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154361:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154364:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154367:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154378:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154381:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154384:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154387:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154391:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154394:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154398:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154403:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154409:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154413:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154418:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154423:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154427:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154431:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154436:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154440:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154446:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154450:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154455:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154460:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154465:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154469:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154473:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154477:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154480:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154483:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154486:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154489:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154492:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154495:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154497:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154500:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154503:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154506:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154509:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154518:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154521:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154524:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154527:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154530:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154534:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.154537:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.154993:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8951d838f400:6532] 0 exiting: rc = 1 00000100:00100000:0.0:1787784710.155099:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8951d838ea00:6533] 1 exiting: rc = 0 00000100:00100000:2.0:1787784710.155306:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155313:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155318:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155323:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155327:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155330:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155334:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155338:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155341:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155344:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155348:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155351:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155355:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155358:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155361:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155364:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155368:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155370:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155373:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155376:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155379:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155381:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155384:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155387:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155390:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155393:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155397:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155401:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155416:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155421:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155426:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155430:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155434:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155439:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155444:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155448:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155454:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155459:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155464:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155468:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155471:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155474:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155478:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155482:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155485:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155489:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155491:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155494:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155497:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155500:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155503:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155507:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155511:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155513:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155517:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155520:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155523:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155526:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155529:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155532:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155535:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155538:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155541:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.155549:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784710.158628:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8951fa957400:6535] 1 exiting: rc = 0 00000100:00100000:0.0:1787784710.158987:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8951ebbe1800:6536] 2 exiting: rc = 0 00000100:00100000:1.0:1787784710.159750:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8951fa956600:6534] 0 exiting: rc = 1 00000100:00100000:2.0:1787784710.160883:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160893:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160899:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160904:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160918:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160925:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160931:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160936:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160942:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160948:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160954:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160960:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160965:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160971:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160977:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160982:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160987:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160992:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.160998:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161004:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161009:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161027:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161043:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161050:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161056:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161062:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161068:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161073:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161078:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161084:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161090:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161096:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161102:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161108:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161130:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161135:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161141:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161147:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161152:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161158:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161164:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161170:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161176:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161181:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161187:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161209:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161215:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161221:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161226:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161231:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161236:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161241:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161246:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161252:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161257:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161262:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161268:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161274:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161279:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161285:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161290:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161296:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161302:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784710.161307:0:15318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787784710.169881:0:15318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784710.169892:0:15318:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787784710.169896:0:15318:0:(genops.c:885:class_export_put()) final put ffff8951f0245800/MDS_uuid 00000020:00000080:3.0:1787784710.169899:0:15318:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f0245800/MDS_uuid for MDS 00000020:01000000:3.0:1787784710.169904:0:15318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787784710.170019:0:15318:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1787784710.662617:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784711.686193:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784712.711507:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784713.735632:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787784714.512429:0:15518:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787784714.524920:0:15518:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787784714.525044:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784714.525058:0:15518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784714.525074:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784714.525082:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784714.525100:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787784714.525106:0:15518:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787784714.525129:0:15518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784714.525133:0:15518:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787784714.525138:0:15518:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787784714.525144:0:15518:0:(import.c:65:import_set_state_nolock()) ffff8950c20de000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787784714.525149:0:15518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784714.525150:0:15518:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787784714.525153:0:15518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787784714.526056:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784714.526066:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784714.526076:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784714.526080:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784714.526090:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784714.526097:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784714.526103:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784714.526106:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787784714.526109:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787784714.526122:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8951faa01800 00010000:00010000:3.0:1787784714.526126:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784714.526133:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951e1d34400/0x88ace7295d9cd71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9cd78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784714.526144:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784714.526146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784714.526148:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784714.527302:0:15518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787784714.527308:0:15518:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787784714.527313:0:15518:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787784714.527333:0:15518:0:(import.c:65:import_set_state_nolock()) ffff8950c20df800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787784714.527403:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874627750173824:0@lo:39:umount.0 00000400:00000100:1.0:1787784714.527453:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627750173824 offset 0 length 224: 4 00010000:00010000:3.0:1787784714.759550:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787784714.886349:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) ee96db03-39cf-4d18-a974-880a628ded6e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784714.886357:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) ee96db03-39cf-4d18-a974-880a628ded6e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784714.886372:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784714.886375:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787784714.886379:0:38:0:(import.c:65:import_set_state_nolock()) ffff8951d87ad000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784714.886386:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 450 00000100:00080000:0.0:1787784714.886392:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787784714.886399:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8951d87ad000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784714.886442:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47f840 x1874627750173952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784714.886624:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784714.886639:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750174080:0@lo:400:kworker.0 00000400:00000100:0.0:1787784714.886693:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627750174080 offset 0 length 224: 4 00000100:00100000:0.0:1787784714.886762:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750173952:0@lo:38:kworker.0 00000400:00000100:0.0:1787784714.886804:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627750173952 offset 0 length 520: 4 00010000:00010000:3.0:1787784715.783241:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787784715.920805:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787784715.920816:0:8431:0:(genops.c:885:class_export_put()) final put ffff8950c20db800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787784715.920911:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c20db800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787784715.920968:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c20da800 for lustre-OST0000 00000001:00100000:3.0:1787784715.922436:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787784715.922443:0:9516:0:(genops.c:885:class_export_put()) final put ffff8951eff1e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787784715.922535:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951eff1e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787784715.922678:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951eff1a000 for lustre-OST0001 00010000:00010000:3.0:1787784716.805929:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784717.830432:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784718.854433:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784719.877930:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787784720.005895:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) ee96db03-39cf-4d18-a974-880a628ded6e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1787784720.005904:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784709/real 1787784709] req@ffff8951ff47c780 x1874627750173696/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787784719 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787784720.005905:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) ee96db03-39cf-4d18-a974-880a628ded6e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784720.005908:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787784720.005912:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787784720.005965:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951ff47c780 x1874627750173696/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787784719 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787784720.005986:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951faa01800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784720.005999:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787784720.006004:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee96db03-39cf-4d18-a974-880a628ded6e:3643:1874627750173696:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:1.0:1787784720.006006:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784720.006018:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750174208:0@lo:400:kworker.0 00000100:00080000:0.0:1787784720.006032:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) ee96db03-39cf-4d18-a974-880a628ded6e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784720.006050:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787784720.006052:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951faa01800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784720.006056:0:15021:0:(import.c:510:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 450 00000100:00080000:0.0:1787784720.006061:0:15021:0:(import.c:589:import_select_connection()) MGC192.168.202.141@tcp: tried all connections, increasing latency to 5s 00000400:00000100:1.0:1787784720.006065:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627750174208 offset 0 length 224: 4 00000100:00080000:0.0:1787784720.006067:0:15021:0:(import.c:624:import_select_connection()) MGC192.168.202.141@tcp: import ffff8951faa01800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784720.006085:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47c780 x1874627750174336/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784720.006097:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784720.006100:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787784720.006113:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee96db03-39cf-4d18-a974-880a628ded6e:3643:1874627750174336:0@lo:250:kworker.0 00000400:00000100:0.0:1787784720.006131:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874627750174336 offset 0 length 520: 4 00010000:00010000:3.0:1787784720.901917:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784721.926026:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784722.950021:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784723.974461:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784724.101960:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784714/real 1787784714] req@ffff8950c3273480 x1874627750173824/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787784724 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784724.102007:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8950c3273480 x1874627750173824/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787784724 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787784724.102032:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c20df800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787784724.102055:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874627750173824:0@lo:39:umount.0 00000100:00080000:2.0:1787784724.102144:0:15518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787784724.102154:0:15518:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787784724.102161:0:15518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787784724.103737:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784724.103756:0:15518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784724.103814:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784724.104542:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784724.104644:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784724.104654:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784724.104663:0:15518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784724.104669:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784724.104674:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784724.104700:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787784724.104705:0:15518:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787784724.104734:0:15518:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787784724.104739:0:15518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787784724.104743:0:15518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784724.104750:0:15518:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787784724.104753:0:15518:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8951effe99b8) has no exports 00000020:00080000:2.0:1787784724.104803:0:15518:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8951effe99b8) has no exports 00010000:00010000:0.0:1787784724.104930:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784724.104945:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784724.104968:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff895201c5b200 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784724.104974:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784724.105008:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784724.105017:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784724.105024:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784724.105027:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787784724.105030:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787784724.105051:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8951faa01800 00010000:00010000:0.0:1787784724.105056:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784724.105062:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff895201c5b200/0x88ace7295d9cd7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9cd86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784724.105081:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784724.105085:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784724.105091:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628a00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784724.105095:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784724.105101:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784724.105108:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784724.105124:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787784724.105126:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787784724.105128:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787784724.105136:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8951faa01800 00010000:00010000:0.0:1787784724.105139:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784724.105145:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9d03b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9d042 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784724.105156:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784724.105158:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784724.105160:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784724.105241:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787784724.112074:0:15518:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8950c30f6f00 - data ffff8950c1c82e58/ffff8950c326ec00 00000020:01000000:2.0:1787784724.112240:0:15518:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8950c22ea060 - data ffff8951f0a82360/ffff8950c235c000 00100000:10000000:2.0:1787784724.120269:0:15518:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787784724.129577:0:15518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cad1 00000020:00000080:3.0:1787784724.129591:0:15518:0:(genops.c:885:class_export_put()) final put ffff8951f81b7800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787784724.129614:0:15518:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951efedf000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787784724.129618:0:15518:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951efedf000 2 00000020:01000004:3.0:1787784724.129621:0:15518:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8951efedf000 from lustre-OST0000 00000020:00000080:3.0:1787784724.129655:0:15518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784724.129666:0:15518:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787784724.129669:0:15518:0:(genops.c:885:class_export_put()) final put ffff8951ebd65000/lustre-OST0000_UUID 00000020:00000080:3.0:1787784724.129671:0:15518:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ebd65000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787784724.129678:0:15518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787784724.129725:0:15518:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787784724.129729:0:15518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787784724.129732:0:15518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784724.129737:0:15518:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787784724.129744:0:15518:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8950c20de800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787784724.129749:0:15518:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8950c20ccd28) has exports, disconnecting them 00000020:00080000:3.0:1787784724.129753:0:15518:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8950c20de800), last request at 1787784474 00000020:00000080:3.0:1787784724.129758:0:15518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cafb 00000020:00080000:3.0:1787784724.129802:0:15518:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8950c20de800): rc 0 00000020:00000080:3.0:1787784724.129807:0:15518:0:(genops.c:885:class_export_put()) final put ffff8950c20de800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787784724.130473:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f81b7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787784724.130488:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c20de800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787784724.250855:0:15518:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787784724.250865:0:15518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787784724.250870:0:15518:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787784724.250878:0:15518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787784724.251045:0:15518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784724.251053:0:15518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787784724.251059:0:15518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787784724.251065:0:15518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784724.251067:0:15518:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787784724.251073:0:15518:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8950c20d9000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787784724.251078:0:15518:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8950c20c8000) has exports, disconnecting them 00000020:00080000:0.0:1787784724.251081:0:15518:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8950c20d9000), last request at 1787784474 00000020:00000080:0.0:1787784724.251084:0:15518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cb10 00000020:00080000:0.0:1787784724.251108:0:15518:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8950c20d9000): rc 0 00000020:00000080:0.0:1787784724.251112:0:15518:0:(genops.c:885:class_export_put()) final put ffff8950c20d9000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787784724.251633:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c20de000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787784724.251639:0:38:0:(genops.c:885:class_export_put()) final put ffff8951f6791000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787784724.251641:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f6791000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787784724.251651:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787784724.251701:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c20d9000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787784724.251715:0:15518:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787784724.251717:0:15518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787784724.251720:0:15518:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787784724.251722:0:15518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787784724.251731:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c20df800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787784724.251878:0:15518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784724.251884:0:15518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787784724.251886:0:15518:0:(genops.c:885:class_export_put()) final put ffff8950c20da000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787784724.251889:0:15518:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c20da000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787784724.251892:0:15518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787784724.251933:0:15518:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951efedf000 1 00000020:00000080:1.0:1787784724.251938:0:15518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9ca99 00000020:00000080:1.0:1787784724.251943:0:15518:0:(genops.c:885:class_export_put()) final put ffff895201c55800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787784724.251951:0:15518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787784724.251958:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff895201c55800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787784724.251966:0:15518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784724.251969:0:15518:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787784724.251971:0:15518:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8951cfef3370) has no exports 00000020:00000080:0.0:1787784724.307485:0:15518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784724.307499:0:15518:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787784724.307505:0:15518:0:(genops.c:885:class_export_put()) final put ffff8951efed9800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787784724.307509:0:15518:0:(genops.c:844:class_export_destroy()) destroying export ffff8951efed9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787784724.307522:0:15518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787784724.307951:0:15518:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8951efeda800 00000020:02000400:0.0:1787784724.308019:0:15518:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787784724.998999:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787784725.133411:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) ee96db03-39cf-4d18-a974-880a628ded6e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787784725.133421:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) ee96db03-39cf-4d18-a974-880a628ded6e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787784725.133424:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787784725.133428:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787784725.133620:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750174464:0@lo:400:kworker.0 00000400:00000100:3.0:1787784725.133675:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627750174464 offset 0 length 224: 4 00010000:00010000:0.0:1787784726.021906:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784727.058363:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784728.071731:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787784728.090417:0:15720:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787784728.105225:0:15720:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787784728.105387:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784728.105403:0:15720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784728.105411:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784728.105419:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784728.105476:0:15720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787784728.105482:0:15720:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787784728.105612:0:15720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787784728.105624:0:15720:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951ff47f840 x1874627750173952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787784734 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784728.105736:0:15720:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787784728.105765:0:15720:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787784728.105804:0:15720:0:(import.c:65:import_set_state_nolock()) ffff8951d87ad000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787784728.105809:0:15720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787784728.105813:0:15720:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951ff47f840 x1874627750173952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787784734 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787784728.105853:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784728.105860:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784728.105868:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030a00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784728.105871:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784728.105888:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784728.105894:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784728.105899:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784728.105901:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787784728.105904:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787784728.105917:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8951faa01800 00010000:00010000:0.0:1787784728.105921:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784728.105933:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0030a00/0x88ace7295d9cd55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9cd5c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784728.105943:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784728.105945:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784728.105947:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784728.106100:0:15720:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787784728.106122:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750173952:0@lo:38:kworker.0 00000100:00100000:3.0:1787784728.106162:0:15720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787784728.107522:0:15720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787784728.107610:0:15720:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951ff47cf00 x1874627750174080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784730 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784728.107920:0:15720:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8950c3412580 x1874627750174208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784736 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784728.107974:0:15720:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951f5291680 x1874627750174464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784741 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784728.107993:0:15720:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787784728.107998:0:15720:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787784728.108023:0:15720:0:(import.c:65:import_set_state_nolock()) ffff8951f50d8000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787784728.108096:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750174464:0@lo:400:kworker.0 00000100:00100000:2.0:1787784728.108128:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874627750174592:0@lo:39:umount.0 00000400:00000100:2.0:1787784728.108175:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627750174592 offset 0 length 224: 4 00000100:00100000:1.0:1787784728.108252:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750174208:0@lo:400:kworker.0 00000100:00100000:0.0:1787784728.108399:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750174080:0@lo:400:kworker.0 00010000:00010000:0.0:1787784729.095659:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784730.122994:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787784730.245905:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) ee96db03-39cf-4d18-a974-880a628ded6e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787784730.245916:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) ee96db03-39cf-4d18-a974-880a628ded6e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787784731.142042:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784732.168828:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784733.190914:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784734.214013:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784735.238224:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784735.303146:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784720/real 1787784720] req@ffff8951ff47c780 x1874627750174336/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787784735 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784735.303236:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951ff47c780 x1874627750174336/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787784735 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787784735.303258:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951faa01800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784735.303285:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787784735.303289:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee96db03-39cf-4d18-a974-880a628ded6e:3643:1874627750174336:0@lo:250:kworker.0 00000100:00080000:0.0:1787784735.303507:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) ee96db03-39cf-4d18-a974-880a628ded6e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784735.303514:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787784735.303516:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951faa01800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784735.303521:0:15021:0:(import.c:510:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 460 00000100:00080000:0.0:1787784735.303527:0:15021:0:(import.c:589:import_select_connection()) MGC192.168.202.141@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787784735.303533:0:15021:0:(import.c:624:import_select_connection()) MGC192.168.202.141@tcp: import ffff8951faa01800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784735.303568:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47cf00 x1874627750174720/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784735.303930:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee96db03-39cf-4d18-a974-880a628ded6e:3643:1874627750174720:0@lo:250:kworker.0 00000400:00000100:2.0:1787784735.303978:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874627750174720 offset 0 length 520: 4 00010000:00010000:0.0:1787784736.264147:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784737.287649:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784738.314560:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784738.373909:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784728/real 1787784728] req@ffff8951f52921c0 x1874627750174592/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787784738 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784738.373941:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951f52921c0 x1874627750174592/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787784738 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787784738.373960:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f50d8000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787784738.373988:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874627750174592:0@lo:39:umount.0 00000100:00080000:3.0:1787784738.374060:0:15720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787784738.374065:0:15720:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787784738.374071:0:15720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787784738.376609:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784738.376629:0:15720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784738.376656:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784738.376662:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784738.376695:0:15720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784738.376704:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784738.376710:0:15720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784738.376716:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784738.376721:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784738.376743:0:15720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787784738.376748:0:15720:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787784738.376815:0:15720:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787784738.376820:0:15720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787784738.376826:0:15720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784738.376832:0:15720:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787784738.376838:0:15720:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8950c20c99b8) has no exports 00000020:00080000:3.0:1787784738.376878:0:15720:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8950c20c99b8) has no exports 00000020:01000000:3.0:1787784738.378741:0:15720:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8950c30f6ae0 - data ffff8950c1c82510/ffff8951fbc00c00 00010000:00010000:1.0:1787784738.378932:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784738.378941:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784738.378952:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:1.0:1787784738.378956:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784738.378966:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784738.378974:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784738.378980:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787784738.378983:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787784738.378985:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787784738.379002:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8951faa01800 00010000:00010000:1.0:1787784738.379006:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784738.379014:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951e1d34800/0x88ace7295d9cd63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9cd6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784738.379031:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784738.379036:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784738.379042:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713a00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:1.0:1787784738.379046:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784738.379072:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784738.379079:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784738.379085:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787784738.379088:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787784738.379090:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787784738.379097:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8951faa01800 00010000:00010000:1.0:1787784738.379100:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784738.379106:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c3713a00/0x88ace7295d9d02d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9d034 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784738.379122:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784738.379124:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784738.379125:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784738.379724:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787784738.380374:0:15720:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8951f501e420 - data ffff8950c1c29000/ffff8951f53a3c00 00100000:10000000:3.0:1787784738.392299:0:15720:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787784738.402058:0:15720:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cbf7 00000020:00000080:0.0:1787784738.402072:0:15720:0:(genops.c:885:class_export_put()) final put ffff8950c26eb800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787784738.402086:0:15720:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951f53b5800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787784738.402090:0:15720:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951f53b5800 2 00000020:01000004:0.0:1787784738.402093:0:15720:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8951f53b5800 from lustre-OST0001 00000020:00000080:0.0:1787784738.402120:0:15720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784738.402141:0:15720:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787784738.402145:0:15720:0:(genops.c:885:class_export_put()) final put ffff8951f6790000/lustre-OST0001_UUID 00000020:00000080:0.0:1787784738.402162:0:15720:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f6790000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787784738.402170:0:15720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787784738.402318:0:15720:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ee96db03-39cf-4d18-a974-880a628ded6e->MGS 00010000:00010000:0.0:1787784738.402346:0:15720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c151e200/0x88ace7295d9c950 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9c957 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784738.402370:0:15720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c151e200/0x88ace7295d9c950 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9c957 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784738.402377:0:15720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787784738.402380:0:15720:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787784738.402384:0:15720:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787784738.402401:0:15720:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8951faa01800 00010000:00010000:0.0:1787784738.402405:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c151e200/0x88ace7295d9c950 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9c957 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784738.402422:0:15720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cdd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9cdda expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784738.402429:0:15720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cdd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9cdda expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784738.402434:0:15720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784738.402436:0:15720:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787784738.402438:0:15720:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787784738.402456:0:15720:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8951faa01800 00010000:00010000:0.0:1787784738.402459:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff895201c5a400/0x88ace7295d9cdd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9cdda expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787784738.402475:0:15720:0:(import.c:65:import_set_state_nolock()) ffff8951faa01800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787784738.402485:0:15720:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787784738.402488:0:15720:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787784738.402489:0:15720:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787784738.402493:0:15720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787784738.402505:0:15720:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951ff47cf00 x1874627750174720/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787784755 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787784738.402521:0:15720:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787784738.402524:0:15720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000020:00000080:0.0:1787784738.402553:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c26eb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1787784738.403374:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee96db03-39cf-4d18-a974-880a628ded6e:3643:1874627750174720:0@lo:250:kworker.0 10000000:01000000:0.0:1787784738.403455:0:15720:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787784738.403464:0:15720:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9c84d 00000020:00000080:0.0:1787784738.403471:0:15720:0:(genops.c:885:class_export_put()) final put ffff8951f0243800/ee96db03-39cf-4d18-a974-880a628ded6e 00000020:01000000:0.0:1787784738.403490:0:15720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.141@tcp (flags='') 00000020:00000080:0.0:1787784738.403498:0:15720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784738.403504:0:15720:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.141@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787784738.403507:0:15720:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8951cfef0000) has no exports 10000000:01000000:3.0:1787784738.403563:0:6518:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1787784738.403633:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f0243800/ee96db03-39cf-4d18-a974-880a628ded6e for MGC192.168.202.141@tcp 10000000:01000000:0.0:1787784738.403726:0:15720:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.141@tcp: client import never connected 00000100:00080000:0.0:1787784738.403729:0:15720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787784738.403732:0:15720:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787784738.403734:0:15720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787784738.403736:0:15720:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787784738.403817:0:15720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784738.403824:0:15720:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.141@tcp (uuid ee96db03-39cf-4d18-a974-880a628ded6e) 00000020:01000000:0.0:1787784738.403830:0:15720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787784738.403833:0:15720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784738.403836:0:15720:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787784738.403841:0:15720:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8951d87aa800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787784738.403846:0:15720:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff895201d0cd28) has exports, disconnecting them 00000020:00080000:0.0:1787784738.403850:0:15720:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8951d87aa800), last request at 1787784497 00000020:00000080:0.0:1787784738.403854:0:15720:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cc21 00000020:00080000:0.0:1787784738.403866:0:15720:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951d87aa800): rc 0 00000020:00000080:0.0:1787784738.403878:0:15720:0:(genops.c:885:class_export_put()) final put ffff8951d87aa800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787784738.404579:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951faa01800 for MGC192.168.202.141@tcp 00000020:00000080:3.0:1787784738.404587:0:38:0:(genops.c:885:class_export_put()) final put ffff8951faa02000/ee96db03-39cf-4d18-a974-880a628ded6e 00000020:00000080:3.0:1787784738.404590:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951faa02000/ee96db03-39cf-4d18-a974-880a628ded6e for MGC192.168.202.141@tcp 00000020:01000000:3.0:1787784738.404595:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.141@tcp (ee96db03-39cf-4d18-a974-880a628ded6e) 00000020:00000080:3.0:1787784738.404870:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951d87aa800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787784738.405968:0:15720:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787784738.405974:0:15720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787784738.405978:0:15720:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787784738.405984:0:15720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787784738.406011:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951d87ad000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787784738.406218:0:15720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784738.406226:0:15720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787784738.406231:0:15720:0:(genops.c:885:class_export_put()) final put ffff8951eff1e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787784738.406234:0:15720:0:(genops.c:844:class_export_destroy()) destroying export ffff8951eff1e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787784738.406239:0:15720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1787784738.406293:0:15720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787784738.406297:0:15720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784738.406301:0:15720:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787784738.406307:0:15720:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8951d87ab800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787784738.406313:0:15720:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff895201d08000) has exports, disconnecting them 00000020:00080000:3.0:1787784738.406317:0:15720:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8951d87ab800), last request at 1787784497 00000020:00000080:3.0:1787784738.406321:0:15720:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cc36 00000020:00080000:3.0:1787784738.406355:0:15720:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951d87ab800): rc 0 00000020:00000080:3.0:1787784738.406359:0:15720:0:(genops.c:885:class_export_put()) final put ffff8951d87ab800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787784738.406388:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951d87ab800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1787784738.410099:0:15720:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787784738.410110:0:15720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787784738.410114:0:15720:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787784738.410123:0:15720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787784738.410250:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787784738.410388:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787784738.411702:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787784738.412176:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8951c8bcd800:6504] 1 exiting: rc = 0 00000020:00000080:3.0:1787784738.412234:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951f50d8000 for lustre-MDT0001-lwp-OST0001 00000100:00100000:2.0:1787784738.412404:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8951c6133a00:6503] 0 exiting: rc = 1 00000100:00100000:1.0:1787784738.412540:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.412880:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8951e1ef6600:6505] 0 exiting: rc = 1 00000100:00100000:1.0:1787784738.412948:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8951df6e6200:6507] 2 exiting: rc = 0 00000100:00100000:1.0:1787784738.413877:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8951df6e7800:6506] 1 exiting: rc = 0 00000100:00100000:3.0:1787784738.417365:0:8452:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8950c19f1400:8452] 3 exiting: rc = 0 00000100:00100000:1.0:1787784738.417609:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417618:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417636:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417642:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417648:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417654:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417660:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417666:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417671:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417678:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417684:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417690:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417696:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417703:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417710:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417716:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417722:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417727:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417733:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417739:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417745:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417751:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417756:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417761:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417798:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417806:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417812:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417818:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417824:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417831:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417836:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417842:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417847:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417853:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417858:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417876:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417881:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417888:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417893:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417897:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417902:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417907:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417913:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417918:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417923:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417929:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417934:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417939:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417944:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417949:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417955:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417960:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417965:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417971:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417976:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417981:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417986:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417992:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.417997:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.418002:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.418008:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.418013:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.418019:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.418025:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787784738.418828:0:15720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784738.418839:0:15720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1787784738.418847:0:15720:0:(genops.c:885:class_export_put()) final put ffff8951d87ac000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1787784738.418852:0:15720:0:(genops.c:844:class_export_destroy()) destroying export ffff8951d87ac000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1787784738.418858:0:15720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1787784738.418918:0:15720:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951f53b5800 1 00000020:00000080:1.0:1787784738.418925:0:15720:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9cbc6 00000020:00000080:1.0:1787784738.418931:0:15720:0:(genops.c:885:class_export_put()) final put ffff8951ff43b000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787784738.418949:0:15720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787784738.418953:0:15720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784738.418958:0:15720:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787784738.418962:0:15720:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8950c25b19b8) has no exports 00000020:00000080:3.0:1787784738.425215:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ff43b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787784738.495904:0:15720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784738.495919:0:15720:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787784738.495925:0:15720:0:(genops.c:885:class_export_put()) final put ffff8951f53b6800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787784738.495930:0:15720:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f53b6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787784738.495937:0:15720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787784738.496668:0:15720:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8951f53b2000 00000020:01000000:1.0:1787784738.496692:0:15720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787784738.496697:0:15720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784738.496701:0:15720:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787784738.496705:0:15720:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8951fb388000) has no exports 00000020:00000080:1.0:1787784738.496740:0:15720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784738.496748:0:15720:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787784738.496752:0:15720:0:(genops.c:885:class_export_put()) final put ffff895201c53800/OSS_uuid 00000020:00000080:1.0:1787784738.496755:0:15720:0:(genops.c:844:class_export_destroy()) destroying export ffff895201c53800/OSS_uuid for OSS 00000020:01000000:1.0:1787784738.496759:0:15720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1787784738.497181:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8951efee0400:8438] 2 exiting: rc = 0 00000100:00100000:2.0:1787784738.497481:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8951fb091800:8437] 1 exiting: rc = 0 00000100:00100000:2.0:1787784738.497542:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8951fb26d800:8436] 0 exiting: rc = 1 00000100:00100000:2.0:1787784738.497667:0:8916:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8951fb28e000:8916] 3 exiting: rc = 0 00000100:00100000:1.0:1787784738.497861:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497875:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497883:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497893:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497902:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497908:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497913:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497918:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497923:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497929:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497934:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497940:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497953:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497958:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497963:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497968:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.497973:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498114:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498123:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498128:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498133:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498137:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498142:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498147:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498244:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498249:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498255:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498262:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498268:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498273:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498279:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498285:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498290:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498295:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498302:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498307:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498312:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498317:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498322:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498337:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498343:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498348:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498354:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498359:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498365:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498370:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498375:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498389:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498395:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498401:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498406:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498411:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498416:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498421:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498426:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498431:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498437:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498442:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498447:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498453:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498459:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498463:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498469:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.498475:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1787784738.499714:0:6517:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787784738.499926:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8951efee0800:8439] 0 exiting: rc = 1 00000100:00100000:1.0:1787784738.500083:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff895201cd1800:8440] 1 exiting: rc = 0 00000100:00100000:0.0:1787784738.500276:0:10759:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8950c2093200:10759] 2 exiting: rc = 0 00000100:00100000:1.0:1787784738.500714:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.500723:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.500763:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502234:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502245:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502250:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502256:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502261:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502267:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502272:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502277:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502281:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502287:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502292:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502297:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502304:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502394:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502402:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502408:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502413:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502418:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502424:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502429:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502435:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502440:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502445:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502450:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502456:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502462:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502467:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502474:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502480:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502485:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502490:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502495:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502500:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502505:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502509:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502515:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502520:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502526:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502531:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502537:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502542:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502548:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502554:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502560:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502566:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502571:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502576:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502582:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502595:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502601:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502606:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502611:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502616:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502621:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502626:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502631:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502636:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502641:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502646:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502650:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784738.502665:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506468:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8951fb26fe00:8442] 1 exiting: rc = 0 00000100:00100000:0.0:1787784738.506644:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8951fb26d200:8441] 0 exiting: rc = 1 00000100:00100000:0.0:1787784738.506854:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8951ebb7d200:8443] 2 exiting: rc = 0 00000100:00100000:0.0:1787784738.506914:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506922:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506937:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506943:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506949:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506955:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506960:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506965:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506971:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506976:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506982:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506987:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506992:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.506997:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507003:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507009:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507014:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507019:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507024:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507029:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507035:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507039:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507045:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507050:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507055:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507061:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507089:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507095:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507100:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507106:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507111:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507116:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507122:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507127:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507132:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507137:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507143:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507148:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507153:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507159:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507164:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507169:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507175:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507180:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507185:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507190:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507196:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507201:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507206:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507211:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507227:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507233:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507238:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507243:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507249:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507254:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507259:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507264:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507283:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507290:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507295:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507310:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507317:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.507322:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.518023:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8951f50b3400:8445] 1 exiting: rc = 0 00000100:00100000:0.0:1787784738.519284:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8951f50b3c00:8444] 0 exiting: rc = 1 00000100:00100000:0.0:1787784738.519470:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519478:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519484:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519489:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519494:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519500:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519505:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519510:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519515:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519522:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519527:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519532:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519537:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519543:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519548:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519553:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519558:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519564:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519570:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519575:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519580:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519585:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519591:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519596:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519601:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519607:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519612:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519617:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519623:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519628:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519650:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519655:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519659:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519665:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519669:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519674:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519679:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519685:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519690:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519696:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519701:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519706:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519712:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519717:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519722:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519727:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519732:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519737:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519742:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519748:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519753:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519758:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519763:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519799:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519805:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519810:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519816:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519821:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519827:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519832:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519837:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519842:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519848:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.519853:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.521964:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8951eff05600:8446] 0 exiting: rc = 1 00000100:00100000:2.0:1787784738.522534:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8951eff04000:8447] 1 exiting: rc = 0 00000100:00100000:0.0:1787784738.522742:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522750:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522756:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522762:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522831:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522859:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522866:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522872:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522878:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522884:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522890:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522896:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522901:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522908:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522914:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522920:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522927:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522950:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522959:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522965:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522972:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522990:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.522997:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523003:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523105:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523117:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523124:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523131:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523139:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523244:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523253:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523259:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523266:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523273:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523279:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523296:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523302:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523310:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523316:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523322:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523408:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523435:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523444:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523449:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523456:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523462:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523469:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523475:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523481:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523487:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523493:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523499:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523504:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523524:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523532:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523539:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523544:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523550:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523557:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523564:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523569:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523577:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523584:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784738.523599:0:15720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787784738.546544:0:15720:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787784761.191537:0:16486:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787784773.515450:0:17086:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787784773.515475:0:17086:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787784773.515478:0:17086:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787784773.515617:0:17086:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8951fb22c000 00000020:01000004:0.0:1787784773.515640:0:17086:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787784773.515649:0:17086:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787784773.515680:0:17086:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8950c20c99b8) 00000020:00000080:0.0:1787784773.515704:0:17086:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787784773.607286:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787784773.608560:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787784773.622399:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787784773.625347:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1787784773.626034:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1787784773.627256:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787784773.630319:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787784773.630649:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787784773.631298:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787784773.631534:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787784773.632048:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1787784773.632964:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787784773.633282:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1787784773.633615:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1787784773.633957:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787784773.636401:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1787784773.636881:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787784773.637417:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1787784773.637677:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787784773.638177:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787784773.640488:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787784773.641972:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787784773.642593:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787784773.642851:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1787784773.643191:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787784773.643991:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787784773.644611:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1787784773.645614:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787784773.646016:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1787784773.646496:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787784773.646815:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1787784773.648841:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787784773.649368:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1787784773.649610:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787784773.649863:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787784773.650151:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787784773.650453:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787784773.652316:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787784773.654304:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787784773.654704:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787784773.655803:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787784773.656817:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787784773.657759:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787784773.658453:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787784773.658723:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787784773.664406:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787784773.665004:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1787784773.677266:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787784773.679147:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787784773.679742:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787784773.680510:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787784773.680723:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1787784773.681222:0:17086:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1787784773.682287:0:17086:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787784773.682502:0:17086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787784773.682511:0:17086:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787784773.682523:0:17086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9de50 00000020:01000004:3.0:1787784773.682529:0:17086:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787784773.682535:0:17086:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787784773.682540:0:17086:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8951fb22c000 from MGS 00000020:01000004:3.0:1787784773.682544:0:17086:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787784773.682555:0:17086:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8950c25b4d28) 00000020:00000080:3.0:1787784773.682566:0:17086:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787784773.682623:0:17086:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951fb22c000 from MGS, refs=2 00080000:01000000:3.0:1787784773.682628:0:17086:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787784773.682642:0:17086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9de5e 00000100:00100000:3.0:1787784773.682732:0:17086:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787784773.687095:0:17086:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787784773.687109:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787784773.691543:0:17086:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787784773.691555:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787784773.692295:0:17086:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784773.692500:0:17086:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787784773.692506:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787784773.697523:0:17086:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787784773.697540:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787784773.698534:0:17086:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787784773.698546:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787784773.699299:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784773.699303:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784773.699305:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784773.699677:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784773.699680:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784773.699682:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784773.702743:0:17086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787784773.711717:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787784773.725310:0:17086:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787784773.731114:0:17098:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787784773.731244:0:17086:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787784773.731305:0:17086:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787784773.732184:0:17086:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787784773.732522:0:17086:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784773.732686:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787784773.732693:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787784773.737517:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787784773.737532:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787784773.738274:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787784773.738282:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787784773.741745:0:17086:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787784773.741810:0:17086:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.141@tcp' 00000020:01000004:2.0:1787784773.741813:0:17086:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:1.0:1787784773.742082:0:17103:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:2.0:1787784773.742343:0:17086:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.141@tcp (typ=mgc) 00000020:00000080:2.0:1787784773.742356:0:17086:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.141@tcp (ffff8951cfef4d28) 00000020:00000080:2.0:1787784773.742370:0:17086:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787784773.742450:0:17086:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c41f8800@MGC192.168.202.141@tcp: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1787784773.742611:0:17086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.141@tcp-0 is initialized 00000040:01000000:2.0:1787784773.742617:0:17086:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787784773.753195:0:17104:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787784773.755348:0:17086:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.141@tcp (uuid a45ddeb3-718a-48eb-8507-e0c94319fca6) 00000020:00000080:2.0:1787784773.755383:0:17086:0:(genops.c:1385:class_connect()) connect: client a45ddeb3-718a-48eb-8507-e0c94319fca6, cookie 0x88ace7295d9de6c 00000100:00080000:2.0:1787784773.755398:0:17086:0:(import.c:510:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784773.755406:0:17086:0:(import.c:624:import_select_connection()) MGC192.168.202.141@tcp: import ffff8950c41f8800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784773.755456:0:17086:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c32712c0 x1874627750174848/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784773.755499:0:17086:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS 00000020:01000004:2.0:1787784773.755535:0:17086:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787784773.755541:0:17086:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787784773.755559:0:17086:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8951cfef0000) 00000020:00000080:2.0:1787784773.755574:0:17086:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787784773.756049:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a45ddeb3-718a-48eb-8507-e0c94319fca6:3643:1874627750174848:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787784773.756129:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784773.767837:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750174848 00000100:00100000:0.0:1787784773.767851:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750174848 00000100:00100000:0.0:1787784773.767900:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784773.767909:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1874627750174848:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787784773.767937:0:17100:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a45ddeb3-718a-48eb-8507-e0c94319fca6@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:0.0:1787784773.767965:0:17100:0:(genops.c:1385:class_connect()) connect: client a45ddeb3-718a-48eb-8507-e0c94319fca6, cookie 0x88ace7295d9de7a 00000100:00080000:0.0:1787784773.768091:0:17100:0:(import.c:65:import_set_state_nolock()) ffff8951fb22e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784773.768178:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+5:3643:x1874627750174848:12345-0@lo:250:mount.lustre.0 Request processed in 269us (12060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784773.768186:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784773.768227:0:3643:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787784773.768236:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.141@tcp: connect to target with instance 0 00000100:00080000:0.0:1787784773.768243:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787784773.768247:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787784773.768250:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c41f8800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787784773.768253:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787784773.768260:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787784773.768265:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a45ddeb3-718a-48eb-8507-e0c94319fca6:3643:1874627750174848:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787784773.783027:0:17086:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784773.783255:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787784773.783263:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787784773.794228:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787784773.794244:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787784773.795556:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787784773.795566:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787784773.796679:0:17086:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784773.799705:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787784773.799715:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787784773.804277:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787784773.804290:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787784773.874942:0:17086:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784773.875322:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787784773.875328:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787784773.876983:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787784773.876996:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787784773.877696:0:17086:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784773.878192:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787784773.878199:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787784773.878951:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787784773.878960:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787784773.879623:0:17086:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784773.879764:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787784773.880273:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787784773.880930:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787784773.880937:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787784773.881666:0:17086:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784773.881942:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787784773.881948:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787784773.882618:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787784773.882625:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787784773.898671:0:17086:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784773.899004:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787784773.899010:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787784773.901696:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787784773.901710:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787784773.902495:0:17086:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787784773.902504:0:17086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787784773.903313:0:17086:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787784773.903340:0:17086:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787784773.903347:0:17086:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787784773.903442:0:17086:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787784773.903488:0:17086:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787784773.903492:0:17086:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787784773.903493:0:17086:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787784773.903494:0:17086:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784773.903495:0:17086:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784773.903496:0:17086:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784773.903497:0:17086:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784773.903498:0:17086:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784773.903499:0:17086:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787784773.903500:0:17086:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784773.903501:0:17086:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787784773.903503:0:17086:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787784773.903504:0:17086:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787784773.903505:0:17086:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787784773.903505:0:17086:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784773.903506:0:17086:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784773.903506:0:17086:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784773.903507:0:17086:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784773.903508:0:17086:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784773.903508:0:17086:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787784773.903509:0:17086:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784773.903513:0:17086:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787784773.903538:0:17086:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787784773.903559:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5292940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750174976:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787784773.903629:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784773.903681:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784773.903756:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750174976 00000100:00100000:0.0:1787784773.903764:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750174976 00000100:00100000:0.0:1787784773.903884:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784773.903890:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+5:17086:x1874627750174976:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787784773.903928:0:17102:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787784773.903930:0:17102:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787784773.903932:0:17102:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787784773.904405:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787784773.904858:0:17102:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1787784773.906185:0:17124:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787784773.906191:0:17124:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787784773.906194:0:17124:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787784773.906197:0:17124:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787784773.906439:0:17124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787784773.906656:0:17102:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787784773.906666:0:17102:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787784773.908416:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+5:17086:x1874627750174976:12345-0@lo:253:mount.lustre.0 Request processed in 4516us (4778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784773.908429:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784773.908531:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5292940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750174976:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787784773.908545:0:17086:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787784773.908548:0:17086:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787784773.908550:0:17086:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787784773.908551:0:17086:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784773.908553:0:17086:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784773.908554:0:17086:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784773.908555:0:17086:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784773.908556:0:17086:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784773.908558:0:17086:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787784773.908559:0:17086:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784773.908561:0:17086:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787784773.908579:0:17086:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8951fb22c000 from lustre-MDT0000 10000000:01000000:3.0:1787784773.908608:0:17086:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787784773.908611:0:17086:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787784773.908615:0:17086:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8951cfef4d28 10000000:01000000:3.0:1787784773.908620:0:17086:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784773.908628:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8951cfef4d28 from 1 10000000:01000000:3.0:1787784773.908631:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787784773.908665:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784773.908675:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784773.908699:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784773.908720:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5292940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750175104:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784773.908756:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784773.908883:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6840 going to sleep for 11 seconds 00000100:00100000:1.0:1787784773.908995:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750175104 00000100:00100000:1.0:1787784773.909001:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750175104 00000100:00100000:1.0:1787784773.909084:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784773.909094:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ce8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+5:17086:x1874627750175104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784773.909106:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784773.909131:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df602600/0x88ace7295d9de88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9de81 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784773.909152:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602600/0x88ace7295d9de88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9de81 expref: 6 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784773.909162:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df602600/0x88ace7295d9de88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9de81 expref: 6 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784773.909170:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602600, rc 0) 00000100:00100000:1.0:1787784773.909221:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ce8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+6:17086:x1874627750175104:12345-0@lo:101:mount.lustre.0 Request processed in 129us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784773.909227:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784773.909290:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5292940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750175104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784773.909303:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784773.909311:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784773.909370:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750175232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784773.909398:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784773.909621:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784773.909704:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750175232 00000100:00100000:3.0:1787784773.909709:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750175232 00000100:00100000:3.0:1787784773.909732:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784773.909738:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+6:17086:x1874627750175232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784773.909900:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+6:17086:x1874627750175232:12345-0@lo:501:mount.lustre.0 Request processed in 162us (501us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784773.909908:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784773.910064:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750175232:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787784773.910091:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787784773.910112:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784773.910305:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784773.910315:0:17086:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8951fb22c000 10000000:01000000:2.0:1787784773.910319:0:17086:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787784773.910323:0:17086:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8951fb22c000 10000000:01000000:2.0:1787784773.910326:0:17086:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787784773.910328:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8951fb22c000 from 1 10000000:01000000:2.0:1787784773.910331:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787784773.910351:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784773.910358:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784773.910365:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784773.910378:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750175360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784773.910404:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784773.910434:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784773.910485:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750175360 00000100:00100000:3.0:1787784773.910490:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750175360 00000100:00100000:3.0:1787784773.910556:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784773.910564:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+6:17086:x1874627750175360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784773.910572:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784773.910583:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3712800/0x88ace7295d9de96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9de8f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784773.910598:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3712800/0x88ace7295d9de96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9de8f expref: 7 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784773.910606:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3712800/0x88ace7295d9de96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9de8f expref: 7 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784773.910624:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712800, rc 0) 00000100:00100000:3.0:1787784773.910662:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+7:17086:x1874627750175360:12345-0@lo:101:mount.lustre.0 Request processed in 99us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784773.910668:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784773.910729:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750175360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784773.910740:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784773.910748:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784773.910790:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787784773.910800:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784773.910807:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784773.910814:0:17086:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787784773.910817:0:17086:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784773.910821:0:17086:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8951fb22c000 10000000:01000000:2.0:1787784773.910824:0:17086:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787784773.910827:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787784773.910828:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787784773.910842:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784773.910848:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784773.910855:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784773.910867:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750175488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784773.910891:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784773.911683:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787784773.911793:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750175488 00000100:00100000:0.0:1787784773.911799:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750175488 00000100:00100000:0.0:1787784773.911843:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784773.911851:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8952021e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+7:17086:x1874627750175488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784773.911861:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784773.911874:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1628200/0x88ace7295d9dea4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9de9d expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784773.911892:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1628200/0x88ace7295d9dea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9de9d expref: 8 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784773.911900:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1628200/0x88ace7295d9dea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9de9d expref: 8 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784773.911908:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628200, rc 0) 00000100:00100000:0.0:1787784773.911957:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8952021e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+8:17086:x1874627750175488:12345-0@lo:101:mount.lustre.0 Request processed in 106us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784773.911963:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784773.916961:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750175488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784773.916994:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784773.917024:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784773.917109:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750175616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784773.917185:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784773.917231:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787784773.917425:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750175616 00000100:00100000:0.0:1787784773.917431:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750175616 00000100:00100000:0.0:1787784773.917478:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787784773.917487:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8952021e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+8:17086:x1874627750175616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784773.917628:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8952021e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+9:17086:x1874627750175616:12345-0@lo:501:mount.lustre.0 Request processed in 141us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784773.917636:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784773.917800:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750175616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784773.917827:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750175744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784773.917864:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784773.917963:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787784773.919593:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750175744 00000100:00100000:1.0:1787784773.919605:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750175744 00000100:00100000:1.0:1787784773.919807:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784773.919818:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+9:17086:x1874627750175744:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784773.920762:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+9:17086:x1874627750175744:12345-0@lo:503:mount.lustre.0 Request processed in 944us (2894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784773.920797:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784773.920908:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750175744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784773.923373:0:17125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17125:1874627750175872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784773.923459:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784773.926036:0:17125:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784773.928692:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750175872 00000100:00100000:3.0:1787784773.928710:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750175872 00000100:00100000:3.0:1787784773.928803:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784773.928816:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+9:17125:x1874627750175872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784773.929861:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+9:17125:x1874627750175872:12345-0@lo:502:llog_process_th.0 Request processed in 1043us (6397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784773.929873:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784773.930018:0:17125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17125:1874627750175872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784773.930056:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784773.930068:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784773.930070:0:17125:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787784773.930076:0:17125:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787784773.930079:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787784773.930094:0:17125:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8951cfef3370) 00000020:00000080:2.0:1787784773.930110:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787784773.930127:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787784773.930338:0:17125:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787784773.930348:0:17125:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9deb2 00000020:00000080:2.0:1787784773.930577:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787784773.930582:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784773.930585:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784773.930586:0:17125:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787784773.930589:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784773.930592:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784773.930594:0:17125:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787784773.930597:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787784773.930604:0:17125:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8951cfef19b8) 00000020:00000080:2.0:1787784773.930615:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787784773.930619:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787784773.930621:0:17125:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787784773.930624:0:17125:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787784773.930629:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787784773.930668:0:17125:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951fb22c000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787784773.930680:0:17125:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8951f02dcd28) 00000020:00000080:2.0:1787784773.930687:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787784773.930745:0:17125:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787784773.930750:0:17125:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9dec7 00000020:00000080:2.0:1787784773.930927:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787784773.930932:0:17125:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787784773.930937:0:17125:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x88ace7295d9dece 00080000:01000000:2.0:1787784773.930942:0:17125:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787784773.930945:0:17125:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9ded5 00010000:00010000:0.0:1787784774.041964:0:17125:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787784774.042590:0:17125:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:0.0:1787784774.046926:0:17125:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787784774.047637:0:17125:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8950c20cb370) 00000020:00000080:0.0:1787784774.047659:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787784774.047756:0:17125:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787784774.047764:0:17125:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9dee3 00000020:00000080:3.0:1787784774.059407:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787784774.063571:0:17125:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x88ace7295d9deea 00000020:00000080:3.0:1787784774.065007:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787784774.065020:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784774.065027:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.065029:0:17125:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787784774.065031:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787784774.065034:0:17125:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787784774.065036:0:17125:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787784774.065037:0:17125:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787784774.065038:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787784774.065041:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.065042:0:17125:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787784774.065044:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784774.065050:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.065052:0:17125:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787784774.065056:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787784774.065099:0:17125:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787784774.065360:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784774.065366:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.065367:0:17125:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787784774.065371:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784774.065374:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.065376:0:17125:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787784774.065379:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787784774.065385:0:17125:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:00000080:3.0:1787784774.065412:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784774.065427:0:17125:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8950c25b0000) 00000020:00000080:3.0:1787784774.065443:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787784774.065449:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787784774.065517:0:17125:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787784774.065523:0:17125:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787784774.065529:0:17125:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9def8 00010000:00080000:3.0:1787784774.065575:0:17125:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951eff2a800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1787784774.071578:0:17125:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1787784774.073809:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787784774.073838:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787784774.073876:0:17125:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787784774.073898:0:17125:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9deff 00000100:00080000:3.0:1787784774.073908:0:17125:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787784774.073914:0:17125:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8951eff2a800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784774.073950:0:17125:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951f5290780 x1874627750176000/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784774.073972:0:17125:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787784774.074030:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784774.074034:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.074036:0:17125:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787784774.074040:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787784774.074050:0:17125:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1787784774.074052:0:17125:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787784774.074054:0:17125:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787784774.074056:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787784774.074058:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.074060:0:17125:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787784774.074063:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787784774.074069:0:17125:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787784774.074073:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.074074:0:17125:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787784774.074077:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787784774.074082:0:17125:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:3.0:1787784774.074110:0:17125:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787784774.074188:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784774.074268:0:17125:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8950c25b19b8) 00000020:00000080:3.0:1787784774.074281:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787784774.074289:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787784774.074341:0:17125:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787784774.074346:0:17125:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787784774.074352:0:17125:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9df0d 00010000:00080000:3.0:1787784774.074378:0:17125:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951c642d800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1787784774.074599:0:17125:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1787784774.075286:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750176000:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787784774.075369:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784774.075473:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750176000 00000100:00100000:0.0:1787784774.075482:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750176000 00000100:00100000:0.0:1787784774.075512:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784774.075519:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750176000:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1787784774.075537:0:17112:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1787784774.085287:0:17125:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787784774.085650:0:17125:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787784774.101568:0:17125:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784774.101940:0:17125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787784774.122508:0:17125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787784774.123749:0:17131:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787784774.123756:0:17131:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787784774.124669:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787784774.124682:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787784774.124721:0:17125:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787784774.124741:0:17125:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9df14 00000100:00080000:1.0:1787784774.124753:0:17125:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784774.124759:0:17125:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8951c642d800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784774.124955:0:17125:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c34130c0 x1874627750176128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784774.124985:0:17125:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787784774.125038:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784774.125042:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784774.125044:0:17125:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787784774.125047:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787784774.125050:0:17125:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1787784774.125051:0:17125:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787784774.125053:0:17125:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787784774.125054:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787784774.125056:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784774.125057:0:17125:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787784774.125059:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787784774.125063:0:17125:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787784774.125066:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784774.125067:0:17125:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787784774.125069:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787784774.125073:0:17125:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:1.0:1787784774.125102:0:17125:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787784774.125105:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784774.125296:0:17125:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff895201d08000) 00000020:00000080:1.0:1787784774.125309:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787784774.125316:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787784774.125385:0:17125:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787784774.125392:0:17125:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787784774.125399:0:17125:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9df22 00010000:00080000:1.0:1787784774.125428:0:17125:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951c3238800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1787784774.125642:0:17125:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787784774.125715:0:17125:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787784774.125729:0:17125:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1787784774.125867:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750176128:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787784774.125919:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750176128 offset 0 length 520: 4 00000100:00100000:1.0:1787784774.128091:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750176000:12345-0@lo:38:llog_process_th.0 Request processed in 52562us (52712us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784774.128109:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787784774.128424:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951eff2a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784774.128431:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787784774.128435:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750176000:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787784774.131058:0:17125:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784774.132931:0:17125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787784774.133156:0:17125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787784774.134031:0:17133:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787784774.134036:0:17133:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787784774.135532:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787784774.135546:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787784774.135588:0:17125:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787784774.135610:0:17125:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9df29 00000100:00080000:1.0:1787784774.135621:0:17125:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784774.135627:0:17125:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8951c3238800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784774.135663:0:17125:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c34121c0 x1874627750176256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784774.135694:0:17125:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787784774.135759:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784774.135791:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784774.135794:0:17125:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787784774.135798:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784774.135802:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784774.135804:0:17125:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787784774.135806:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787784774.135808:0:17125:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787784774.135810:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784774.135812:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784774.135813:0:17125:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787784774.135815:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784774.135818:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1787784774.135990:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750176256:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787784774.136048:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750176256 offset 0 length 520: 4 00000020:00000080:1.0:1787784774.137387:0:17125:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787784774.137412:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787784774.137469:0:17125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3411a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17125:1874627750176384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784774.137551:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784774.137590:0:17125:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52af900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784774.137815:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750176384 00000100:00100000:3.0:1787784774.137836:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750176384 00000100:00100000:3.0:1787784774.137896:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787784774.137914:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+9:17125:x1874627750176384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784774.138056:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+9:17125:x1874627750176384:12345-0@lo:502:llog_process_th.0 Request processed in 144us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784774.138064:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787784774.138421:0:17125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3411a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17125:1874627750176384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784774.138470:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784774.138476:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784774.138479:0:17125:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787784774.138485:0:17125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787784774.139510:0:17086:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1787784774.139542:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787784774.139564:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784774.139576:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784774.139584:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951fb22c000 from 1 10000000:01000000:0.0:1787784774.139588:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787784774.139622:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784774.139629:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784774.139639:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784774.139658:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750176512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787784774.139706:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784774.139753:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f0297180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784774.140005:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750176512 00000100:00100000:3.0:1787784774.140011:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750176512 00000100:00100000:3.0:1787784774.140054:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787784774.140063:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+9:17086:x1874627750176512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784774.140074:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784774.140086:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3712a00/0x88ace7295d9df37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9df30 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784774.140106:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3712a00/0x88ace7295d9df37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9df30 expref: 10 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784774.140127:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3712a00/0x88ace7295d9df37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9df30 expref: 10 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784774.140136:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712a00, rc 0) 00000100:00100000:3.0:1787784774.140184:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+10:17086:x1874627750176512:12345-0@lo:101:mount.lustre.0 Request processed in 122us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784774.140190:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784774.140373:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750176512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784774.140389:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.140397:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9df37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784774.140967:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750176640:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787784774.141008:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784774.141031:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9240 going to sleep for 11 seconds 00000100:00100000:1.0:1787784774.141146:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750176640 00000100:00100000:1.0:1787784774.141157:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750176640 00000100:00100000:1.0:1787784774.141192:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787784774.141209:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+10:17086:x1874627750176640:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787784774.141225:0:17101:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787784774.141232:0:17101:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787784774.141308:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+10:17086:x1874627750176640:12345-0@lo:256:mount.lustre.0 Request processed in 109us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784774.141315:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784774.141502:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750176640:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787784774.142387:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787784774.142410:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.142421:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784774.142429:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951fb22c000 from 1 10000000:01000000:2.0:1787784774.142432:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784774.142468:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.142477:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.142540:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784774.142558:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750176768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784774.142599:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784774.142792:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787784774.147020:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750176768 00000100:00100000:0.0:1787784774.147037:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750176768 00000100:00100000:2.0:1787784774.147219:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784774.147232:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+10:17086:x1874627750176768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784774.147251:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784774.147273:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c4183000/0x88ace7295d9df45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9df3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.147302:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c4183000/0x88ace7295d9df45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9df3e expref: 11 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.147315:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c4183000/0x88ace7295d9df45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9df3e expref: 11 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.147324:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183000, rc 0) 00000100:00100000:2.0:1787784774.147413:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+11:17086:x1874627750176768:12345-0@lo:101:mount.lustre.0 Request processed in 183us (4812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784774.147420:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784774.147677:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750176768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784774.147697:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df45 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784774.147707:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9df45 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784774.147817:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3411680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750176896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784774.147864:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784774.147895:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52af540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784774.147995:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750176896 00000100:00100000:2.0:1787784774.147999:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750176896 00000100:00100000:2.0:1787784774.148019:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787784774.148025:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+11:17086:x1874627750176896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784774.148163:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+11:17086:x1874627750176896:12345-0@lo:501:mount.lustre.0 Request processed in 137us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784774.148184:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784774.148330:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3411680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750176896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784774.148357:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3411680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750177024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784774.148396:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784774.148427:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52af540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784774.148496:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750177024 00000100:00100000:0.0:1787784774.148502:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750177024 00000100:00100000:0.0:1787784774.148525:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787784774.148541:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+11:17086:x1874627750177024:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784774.148639:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+11:17086:x1874627750177024:12345-0@lo:503:mount.lustre.0 Request processed in 100us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784774.148647:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784774.148729:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3411680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750177024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784774.149016:0:17135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3411680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17135:1874627750177152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784774.149054:0:17135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784774.149083:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750177152 00000100:00100000:1.0:1787784774.149087:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750177152 00000100:00100000:1.0:1787784774.149106:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784774.149125:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+11:17135:x1874627750177152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784774.149475:0:17135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52af600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784774.149936:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+11:17135:x1874627750177152:12345-0@lo:502:llog_process_th.0 Request processed in 822us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784774.149945:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784774.150074:0:17135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3411680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17135:1874627750177152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784774.150101:0:17135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784774.150111:0:17135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.150123:0:17135:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787784774.150132:0:17135:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951fb22c000 00000020:00000080:3.0:1787784774.150134:0:17135:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784774.150148:0:17135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784774.150151:0:17135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.150152:0:17135:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787784774.150154:0:17135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784774.150157:0:17135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.150158:0:17135:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787784774.150162:0:17135:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951fb22c000 00000020:00000080:3.0:1787784774.150164:0:17135:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784774.150230:0:17135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784774.150234:0:17135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.150236:0:17135:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787784774.150238:0:17135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784774.150241:0:17135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.150242:0:17135:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787784774.150245:0:17135:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951fb22c000 00000020:00000080:3.0:1787784774.150247:0:17135:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784774.150267:0:17135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784774.150270:0:17135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.150272:0:17135:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787784774.150274:0:17135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784774.150276:0:17135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.150278:0:17135:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787784774.150281:0:17135:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951fb22c000 00000020:00000080:3.0:1787784774.150283:0:17135:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787784774.150320:0:17135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17135:1874627750177280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784774.150361:0:17135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784774.150397:0:17135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33b5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784774.150572:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750177280 00000100:00100000:0.0:1787784774.150579:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750177280 00000100:00100000:0.0:1787784774.150626:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787784774.150635:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+11:17135:x1874627750177280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784774.150726:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+11:17135:x1874627750177280:12345-0@lo:502:llog_process_th.0 Request processed in 92us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784774.150734:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784774.152124:0:17135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17135:1874627750177280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784774.152158:0:17135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784774.152165:0:17135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784774.152167:0:17135:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787784774.152171:0:17135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787784774.153218:0:17086:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787784774.153249:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784774.153266:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df45 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.153278:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df45 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784774.153338:0:17086:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787784774.153341:0:17086:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8951fb22c000 10000000:01000000:2.0:1787784774.153344:0:17086:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8951fb22c000 10000000:01000000:2.0:1787784774.153349:0:17086:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784774.153355:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951fb22c000 from 1 10000000:01000000:2.0:1787784774.153358:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787784774.153388:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.153396:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.153405:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784774.153425:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750177408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784774.153502:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784774.153542:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f52e9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784774.164844:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750177408 00000100:00100000:3.0:1787784774.164858:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750177408 00000100:00100000:3.0:1787784774.164919:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787784774.164929:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+11:17086:x1874627750177408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784774.164948:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784774.164966:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3712000/0x88ace7295d9df53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9df4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784774.164992:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3712000/0x88ace7295d9df53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9df4c expref: 12 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784774.165004:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3712000/0x88ace7295d9df53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9df4c expref: 12 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784774.165013:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712000, rc 0) 00000100:00100000:3.0:1787784774.165082:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17086:x1874627750177408:12345-0@lo:101:mount.lustre.0 Request processed in 156us (11581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784774.165088:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787784774.165840:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750177408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784774.165864:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784774.165888:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784774.165967:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750177536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784774.166012:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784774.172711:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f0297180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784774.175481:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750177536 00000100:00100000:3.0:1787784774.175495:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750177536 00000100:00100000:3.0:1787784774.175698:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784774.175712:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17086:x1874627750177536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784774.175912:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17086:x1874627750177536:12345-0@lo:501:mount.lustre.0 Request processed in 203us (9899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784774.175920:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787784774.179138:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750177536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784774.179212:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750177664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784774.179291:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784774.179340:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66f780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784774.179440:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750177664 00000100:00100000:3.0:1787784774.179447:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750177664 00000100:00100000:3.0:1787784774.179518:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787784774.179529:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17086:x1874627750177664:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784774.179661:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17086:x1874627750177664:12345-0@lo:503:mount.lustre.0 Request processed in 133us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784774.179670:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787784774.179822:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750177664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784774.188836:0:17140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17140:1874627750177792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784774.188924:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784774.188965:0:17140:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66f000 going to sleep for 11 seconds 00000100:00100000:3.0:1787784774.189043:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750177792 00000100:00100000:3.0:1787784774.189051:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750177792 00000100:00100000:3.0:1787784774.189100:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787784774.189109:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17140:x1874627750177792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784774.189263:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17140:x1874627750177792:12345-0@lo:502:llog_process_th.0 Request processed in 154us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784774.189272:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787784774.189471:0:17140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17140:1874627750177792:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787784774.189533:0:17140:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787784774.189548:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff895201d0b370) 00000020:00000080:1.0:1787784774.189567:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1787784774.189663:0:17140:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951fb22c000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787784774.189668:0:17140:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951fb22c000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787784774.189670:0:17140:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951fb22c000 4 00010000:00080000:1.0:1787784774.189713:0:17140:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951fa908800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1787784774.193023:0:17140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1787784774.193233:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787784774.193273:0:17140:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787784774.193287:0:17140:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x88ace7295d9df61 00000100:00080000:1.0:1787784774.193296:0:17140:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784774.193302:0:17140:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8951fa908800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784774.193334:0:17140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c3410000 x1874627750177920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784774.193359:0:17140:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787784774.193575:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750177920:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787784774.193662:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784774.193847:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750177920 00000100:00100000:2.0:1787784774.193855:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750177920 00000100:00100000:1.0:1787784774.193859:0:17140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17140:1874627750178048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784774.193901:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784774.193911:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874627750177920:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784774.193920:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784774.193950:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750178048 00000100:00100000:1.0:1787784774.193954:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750178048 00000100:00100000:2.0:1787784774.193974:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874627750177920:12345-0@lo:38:llog_process_th.0 Request processed in 62us (311us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787784774.193982:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784774.193986:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784774.193995:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17140:x1874627750178048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784774.194045:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784774.194054:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951fa908800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784774.194059:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787784774.194063:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750177920:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784774.194095:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17140:x1874627750178048:12345-0@lo:502:llog_process_th.0 Request processed in 100us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784774.194103:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784774.194264:0:17140:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784774.194278:0:17140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17140:1874627750178048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784774.194316:0:17140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17140:1874627750178176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784774.194352:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784774.194420:0:17140:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784774.194468:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750178176 00000100:00100000:0.0:1787784774.194473:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750178176 00000100:00100000:0.0:1787784774.194540:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787784774.194547:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17140:x1874627750178176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784774.194632:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17140:x1874627750178176:12345-0@lo:502:llog_process_th.0 Request processed in 85us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784774.194639:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787784774.194696:0:17140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a45ddeb3-718a-48eb-8507-e0c94319fca6:17140:1874627750178176:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787784774.194715:0:17140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787784774.194936:0:17086:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787784774.194959:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787784774.194979:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784774.194992:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787784774.195042:0:17086:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787784774.195044:0:17086:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787784774.195046:0:17086:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784774.195047:0:17086:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784774.195049:0:17086:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784774.195050:0:17086:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784774.195051:0:17086:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784774.195053:0:17086:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787784774.195054:0:17086:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784774.195055:0:17086:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787784774.195059:0:17086:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787784774.195061:0:17086:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787784774.195062:0:17086:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787784774.195066:0:17086:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784774.195067:0:17086:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784774.195068:0:17086:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784774.195069:0:17086:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784774.195070:0:17086:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784774.195071:0:17086:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787784774.195072:0:17086:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784774.195073:0:17086:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787784774.195088:0:17086:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787784774.195098:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750178304:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787784774.195146:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784774.195168:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784774.195201:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750178304 00000100:00100000:1.0:1787784774.195212:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750178304 00000100:00100000:1.0:1787784774.195250:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787784774.195258:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17086:x1874627750178304:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787784774.195278:0:17100:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787784774.195291:0:17100:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787784774.203125:0:17100:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787784774.203148:0:17100:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787784774.203274:0:17123:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787784774.203280:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787784774.203306:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.203325:0:17123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8950c3712a00/0x88ace7295d9df37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9df30 expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.203334:0:17123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.203379:0:17123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8950c3712a00/0x88ace7295d9df37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9df30 expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.203394:0:17123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8950c3712a00/0x88ace7295d9df37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9df30 expref: 12 pid: 17102 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784774.203409:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750178432:0@lo:104: 00000100:00100000:2.0:1787784774.203486:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784774.203533:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4f47180 going to sleep for 11 seconds 00000100:00100000:0.0:1787784774.204251:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750178432 00000100:00100000:0.0:1787784774.204262:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750178432 00000100:00100000:0.0:1787784774.204313:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784774.204322:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+3:17123:x1874627750178432:12345-0@lo:104: 00010000:00010000:0.0:1787784774.204336:0:17090:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9df37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784774.204585:0:17090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784774.204592:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+3:17123:x1874627750178432:12345-0@lo:104: Request processed in 271us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784774.204598:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787784774.205845:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784774.205856:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9df37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.205868:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784774.205872:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9df37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.205881:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9df37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784774.205887:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9df37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784774.205893:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784774.205944:0:17096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9df37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.205951:0:17096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784774.205971:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9df37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.205978:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9df30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9df37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784774.205999:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784774.206001:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784774.206002:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784774.206032:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784774.206044:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750178560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784774.206094:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784774.206556:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750178560 00000100:00100000:1.0:1787784774.206566:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750178560 00010000:00010000:1.0:1787784774.206592:0:17092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8950c3712a00/0x88ace7295d9df37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9df30 expref: 13 pid: 17102 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784774.206631:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784774.206641:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+13:3646:x1874627750178560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784774.206653:0:17092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784774.206657:0:17092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8950c3712a00/0x88ace7295d9df37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9df30 expref: 13 pid: 17102 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784774.206669:0:17092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8950c3712a00/0x88ace7295d9df37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9df30 expref: 13 pid: 17102 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784774.206689:0:17092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784774.206697:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787784774.206713:0:17092:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003433733s 00010000:00010000:1.0:1787784774.206718:0:17092:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784774.206726:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784774.206745:0:17092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784774.206752:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784774.206757:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784774.206762:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784774.206809:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784774.206820:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784774.206830:0:17092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784774.206872:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+13:3646:x1874627750178560:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784774.206879:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784774.206916:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750178560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784774.214746:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3712a00/0x88ace7295d9df37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9df30 expref: 12 pid: 17102 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784774.214784:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750178432:0@lo:104: 00010000:00010000:3.0:1787784774.214808:0:17123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784774.214819:0:17123:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784774.214825:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784774.214830:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c4182600/0x88ace7295d9df68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784774.215025:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+11:17086:x1874627750178304:12345-0@lo:253:mount.lustre.0 Request processed in 19766us (19878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784774.215036:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787784774.215389:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17086:1874627750178304:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787784774.215401:0:17086:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787784774.215414:0:17086:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787784774.215415:0:17086:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787784774.215417:0:17086:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784774.215418:0:17086:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784774.215419:0:17086:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784774.215421:0:17086:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784774.215422:0:17086:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784774.215423:0:17086:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787784774.215425:0:17086:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784774.215427:0:17086:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787784774.215438:0:17086:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1787784774.238845:0:17086:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787784774.245316:0:17086:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787784774.245991:0:17146:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787784774.245997:0:17146:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787784774.246067:0:17147:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787784774.246470:0:17086:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1787784774.247417:0:17147:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1787784774.248417:0:17148:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8951f5291a40 x1874627750178688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784774.248431:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00000040:01000000:0.0:1787784774.249153:0:17086:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787784774.249298:0:17086:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787784774.250594:0:17086:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787784774.250613:0:17086:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787784774.250694:0:17086:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784774.252194:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787784774.252331:0:17147:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1787784774.252356:0:17086:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787784774.252979:0:17086:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787784774.253008:0:17086:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787784774.254398:0:17086:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1787784774.259432:0:17086:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787784774.261600:0:17086:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787784774.261637:0:17086:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb77a01673988 00100000:10000000:0.0:1787784774.261645:0:17086:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787784774.262825:0:17086:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787784774.262842:0:17086:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787784774.262862:0:17086:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787784774.262888:0:17086:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787784774.267725:0:17086:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784774.267998:0:17086:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787784774.726107:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787784775.241624:0:17104:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787784775.241633:0:17104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951fb22c000 from 7 10000000:01000000:0.0:1787784775.241639:0:17104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787784775.241684:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784775.241696:0:17104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784775.241707:0:17104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784775.241735:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750178816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784775.241838:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784775.241888:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951cfeb6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784775.241912:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750178816 00000100:00100000:0.0:1787784775.241918:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750178816 00000100:00100000:0.0:1787784775.241966:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787784775.241975:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+11:17104:x1874627750178816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784775.241988:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784775.242002:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1629c00/0x88ace7295d9df76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9df6f expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784775.242025:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629c00/0x88ace7295d9df76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9df6f expref: 12 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784775.242052:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1629c00/0x88ace7295d9df76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9df6f expref: 12 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784775.242060:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629c00, rc 0) 00000100:00100000:0.0:1787784775.242101:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17104:x1874627750178816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784775.242108:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787784775.242157:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750178816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784775.242173:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df76 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784775.242182:0:17104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9df76 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784775.242235:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750178944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787784775.242267:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784775.242280:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951cfeb6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784775.242292:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750178944 00000100:00100000:0.0:1787784775.242296:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750178944 00000100:00100000:0.0:1787784775.242318:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784775.242323:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17104:x1874627750178944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787784775.242337:0:17100:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787784775.242355:0:17100:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787784775.242358:0:17100:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787784775.242439:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17104:x1874627750178944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784775.242467:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784775.242499:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750178944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787784775.242536:0:17104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787784775.242544:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df76 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784775.242551:0:17104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df76 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787784775.243334:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787784775.303386:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00010000:00010000:0.0:1787784775.755268:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787784776.262642:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787784776.325972:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00010000:00010000:3.0:1787784776.775218:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784777.349873:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00010000:00010000:0.0:1787784777.799211:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784778.387960:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00010000:00010000:3.0:1787784778.823198:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787784779.398063:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787784779.398072:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787784779.398075:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951eff2a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784779.398084:0:15021:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:3.0:1787784779.398091:0:15021:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787784779.398097:0:15021:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8951eff2a800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784779.398122:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951f5293c00 x1874627750179200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784779.398144:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784779.398163:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787784779.398166:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784779.398169:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787784779.398172:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787784779.398174:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787784779.398176:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951fa908800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784779.398194:0:15021:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8951fa908800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784779.398210:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951f52921c0 x1874627750179328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784779.398255:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784779.398271:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750179072:0@lo:400:kworker.0 00000100:00100000:3.0:1787784779.398280:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750179200:0@lo:38:kworker.0 00000100:00100000:1.0:1787784779.403383:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00000100:00100000:3.0:1787784779.406003:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784779.408806:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784779.408907:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750179072 00000100:00100000:0.0:1787784779.408918:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750179072 00000100:00100000:0.0:1787784779.408976:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784779.408986:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:3645:x1874627750179072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784779.409048:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:3645:x1874627750179072:12345-0@lo:400:kworker.0 Request processed in 64us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784779.409057:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784779.409747:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750179072:0@lo:400:kworker.0 00000100:00100000:3.0:1787784779.411007:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750179328:0@lo:38:kworker.0 00000100:00100000:3.0:1787784779.411063:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784779.413000:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750179328 00000100:00100000:1.0:1787784779.413020:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750179328 00000100:00100000:1.0:1787784779.413073:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784779.413082:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874627750179328:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787784779.413115:0:17109:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:1.0:1787784779.413156:0:17109:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x88ace7295d9df7d 00000004:00100000:1.0:1787784779.413176:0:17109:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787784779.413369:0:17109:0:(import.c:65:import_set_state_nolock()) ffff8951f67db800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784779.413467:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874627750179328:12345-0@lo:38:kworker.0 Request processed in 384us (2402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784779.413474:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787784779.413526:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8951f52921c0 x1874627750179328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787784779.413543:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787784779.413551:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787784779.413557:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787784779.413559:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951fa908800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787784779.413567:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750179328:0@lo:38:kworker.0 00000100:00100000:1.0:1787784779.413602:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750179200 00000100:00100000:1.0:1787784779.413607:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750179200 00000100:00100000:1.0:1787784779.413634:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784779.413640:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5291680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750179200:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787784779.413651:0:17112:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787784779.435149:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5291680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750179200:12345-0@lo:38:kworker.0 Request processed in 21499us (29148us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784779.435164:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787784779.435232:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951eff2a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784779.435237:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787784779.435241:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750179200:0@lo:38:kworker.0 00000001:02000400:1.0:1787784779.462821:0:17391:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787784779.845901:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784780.422981:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00000020:00000004:2.0:1787784780.484979:0:17443:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784780.485322:0:17443:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787784780.870177:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784781.450009:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00000020:00000004:0.0:1787784781.452552:0:17493:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787784781.452715:0:17493:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787784781.894023:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784782.470342:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00010000:00010000:0.0:1787784782.920320:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784783.493867:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00010000:00010000:1.0:1787784783.943664:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787784784.517985:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787784784.517993:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787784784.517996:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951eff2a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784784.518005:0:15021:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:3.0:1787784784.518011:0:15021:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787784784.518018:0:15021:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8951eff2a800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784784.518042:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951f52912c0 x1874627750179584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784784.518072:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784784.518076:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787784784.518078:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784784.518082:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787784784.518152:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750179456:0@lo:400:kworker.0 00000100:00100000:3.0:1787784784.518351:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784784.518437:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750179712:0@lo:400:kworker.0 00000100:00100000:3.0:1787784784.518465:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784784.518558:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750179456 00000100:00100000:3.0:1787784784.518565:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750179456 00000100:00100000:1.0:1787784784.518603:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784774/real 1787784774] req@ffff8950c34121c0 x1874627750176256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784784 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784784.518642:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8950c34121c0 x1874627750176256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784784 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784784.518651:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784774/real 1787784774] req@ffff8950c34130c0 x1874627750176128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784784 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784784.518665:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8950c34130c0 x1874627750176128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784784 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784784.518678:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750179584:0@lo:38:kworker.0 00000100:00100000:0.0:1787784784.518680:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00000100:00100000:1.0:1787784784.518714:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787784784.518736:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1787784784.518738:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750179584 00000100:00100000:0.0:1787784784.518744:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750179584 00000100:00080000:1.0:1787784784.518753:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787784784.518758:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750176256:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787784784.518764:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c642d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784784.518798:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787784784.518803:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750176128:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787784784.518819:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784784.518836:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787784784.518837:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750179584:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787784784.518855:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00020000:0.0:1787784784.518859:0:17113:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1787784784.518871:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784784.518877:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787784784.518879:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951c642d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784784.518884:0:15021:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:1.0:1787784784.518888:0:15021:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787784784.518892:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8951c642d800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784784.518908:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c34130c0 x1874627750179840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784784.518923:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784784.518926:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787784784.518927:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784784.518930:0:15021:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:1.0:1787784784.518933:0:15021:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787784784.518936:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8951c3238800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784784.518947:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c34121c0 x1874627750179968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784784.518966:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750179840:0@lo:8:kworker.0 00000400:00000100:1.0:1787784784.518992:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750179840 offset 0 length 520: 4 00000100:00100000:1.0:1787784784.519011:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750179968:0@lo:8:kworker.0 00000400:00000100:1.0:1787784784.519527:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750179968 offset 0 length 520: 4 00000100:00100000:3.0:1787784784.520021:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784784.520032:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:3645:x1874627750179456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784784.520095:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:3645:x1874627750179456:12345-0@lo:400:kworker.0 Request processed in 65us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784784.520102:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784784.520165:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750179712 00000100:00100000:3.0:1787784784.520172:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750179712 00000100:00100000:3.0:1787784784.522434:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784784.522453:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750179712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784784.522552:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750179712:12345-0@lo:400:kworker.0 Request processed in 106us (4085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784784.522559:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787784784.524452:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8951f5293480 x1874627750179712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784784.524494:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750179712:0@lo:400:kworker.0 00000100:00100000:3.0:1787784784.524536:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750179456:0@lo:400:kworker.0 00000100:00100000:1.0:1787784784.552189:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750179584:12345-0@lo:38:kworker.0 Request processed in 33345us (33469us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784784.552204:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787784784.552804:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951eff2a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784784.552812:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787784784.552817:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750179584:0@lo:38:kworker.0 00010000:00010000:2.0:1787784784.969623:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784785.541860:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00010000:00010000:1.0:1787784785.991484:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787784786.515943:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787784786.565849:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00010000:00010000:2.0:1787784787.014185:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784787.590871:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00010000:00010000:0.0:1787784788.038975:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787784788.409648:0:17839:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787784788.409653:0:17839:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787784788.409654:0:17839:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787784788.409822:0:17839:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8950c4020000 00000020:01000004:3.0:1787784788.409840:0:17839:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787784788.409853:0:17839:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787784788.409865:0:17839:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8950c25b3370) 00000020:00000080:3.0:1787784788.409880:0:17839:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787784788.537907:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787784788.538399:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.539525:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787784788.539708:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787784788.540496:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787784788.540676:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787784788.540879:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787784788.541396:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787784788.541823:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787784788.542601:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787784788.542852:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787784788.543098:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787784788.543477:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1787784788.543662:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787784788.545749:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.546285:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.546578:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.546793:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.547041:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.547542:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.547746:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.548216:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.549066:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.550063:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.550886:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.551284:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.551676:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.551910:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.552449:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.552753:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.553211:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.553556:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.553865:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.554269:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.554647:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.554886:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.555415:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.555804:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.556028:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.556411:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.556708:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787784788.557046:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.557524:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.557738:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.557924:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787784788.558296:0:17839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00080000:01000000:0.0:1787784788.563918:0:17839:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787784788.564533:0:17839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787784788.564545:0:17839:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787784788.564558:0:17839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9df8b 00000020:01000004:0.0:1787784788.564567:0:17839:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787784788.564590:0:17839:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787784788.564594:0:17839:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787784788.564601:0:17839:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787784788.564630:0:17839:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787784788.564636:0:17839:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787784788.569763:0:17839:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787784788.569819:0:17839:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.141@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1787784788.569823:0:17839:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787784788.569825:0:17839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787784788.569829:0:17839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784788.569831:0:17839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784788.569832:0:17839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784788.569833:0:17839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784788.569834:0:17839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787784788.569836:0:17839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784788.569837:0:17839:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784788.569840:0:17839:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1787784788.569842:0:17839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787784788.569843:0:17839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787784788.569844:0:17839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784788.569845:0:17839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784788.569846:0:17839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784788.569847:0:17839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784788.569848:0:17839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787784788.569849:0:17839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784788.569850:0:17839:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784788.569874:0:17839:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787784788.569893:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180096:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787784788.569960:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.570073:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e33240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784788.570263:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750180096 00000100:00100000:2.0:1787784788.570270:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750180096 00000100:00100000:2.0:1787784788.570418:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787784788.570429:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17839:x1874627750180096:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787784788.570463:0:17100:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787784788.570466:0:17100:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1787784788.570473:0:17100:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787784788.570765:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17839:x1874627750180096:12345-0@lo:253:mount.lustre.0 Request processed in 338us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.570799:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787784788.570888:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180096:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787784788.570898:0:17839:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787784788.570901:0:17839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787784788.570902:0:17839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787784788.570903:0:17839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784788.570904:0:17839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784788.570905:0:17839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784788.570906:0:17839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784788.570907:0:17839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787784788.570909:0:17839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784788.570910:0:17839:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787784788.570928:0:17839:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8950c4020000 from lustre-MDT0001 10000000:01000000:0.0:1787784788.570963:0:17839:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787784788.570966:0:17839:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787784788.570973:0:17839:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8951cfef4d28 local copy 00010000:00010000:0.0:1787784788.570988:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784788.571076:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784788.571106:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.571479:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e330c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784788.571543:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750180224 00000100:00100000:3.0:1787784788.571548:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750180224 00000100:00100000:3.0:1787784788.571575:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787784788.571582:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17839:x1874627750180224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784788.571690:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17839:x1874627750180224:12345-0@lo:501:mount.lustre.0 Request processed in 108us (582us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784788.571698:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787784788.571839:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180224:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787784788.571854:0:17839:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787784788.571872:0:17839:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787784788.571878:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.571887:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784788.571911:0:17839:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8950c4020000 10000000:01000000:0.0:1787784788.571916:0:17839:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787784788.571921:0:17839:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8951cfef4d28 10000000:01000000:0.0:1787784788.571924:0:17839:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787784788.571927:0:17839:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8951cfef4d28 from 1 10000000:01000000:0.0:1787784788.571929:0:17839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787784788.571952:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9df92 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.572073:0:17839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9df92 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.572082:0:17839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9df92 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784788.572095:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787784788.572129:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.572194:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784788.572478:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750180352 00000100:00100000:1.0:1787784788.572484:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750180352 00000100:00100000:3.0:1787784788.572536:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787784788.572544:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+12:17839:x1874627750180352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784788.572553:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784788.572566:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3713800/0x88ace7295d9df99 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9df92 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.572586:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3713800/0x88ace7295d9df99 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9df92 expref: 13 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.572595:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3713800/0x88ace7295d9df99 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9df92 expref: 13 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.572610:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713800, rc 0) 00000100:00100000:3.0:1787784788.572650:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+13:17839:x1874627750180352:12345-0@lo:101:mount.lustre.0 Request processed in 107us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784788.572656:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787784788.572730:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784788.572741:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9df92 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df99 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.572749:0:17839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9df92 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9df99 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784788.572763:0:17839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787784788.572796:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9df92 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df99 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.572804:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9df92 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df99 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784788.572812:0:17839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8950c4020000 10000000:01000000:0.0:1787784788.572816:0:17839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787784788.572819:0:17839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8950c4020000 from 1 10000000:01000000:0.0:1787784788.572821:0:17839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787784788.572835:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.572841:0:17839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.572848:0:17839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784788.572860:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787784788.572893:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.572918:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e330c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784788.573494:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750180480 00000100:00100000:3.0:1787784788.573500:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750180480 00000100:00100000:3.0:1787784788.573540:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787784788.573547:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+13:17839:x1874627750180480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784788.573555:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784788.573566:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3712a00/0x88ace7295d9dfa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9dfa0 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.573580:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3712a00/0x88ace7295d9dfa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9dfa0 expref: 14 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.573589:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3712a00/0x88ace7295d9dfa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9dfa0 expref: 14 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.573596:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712a00, rc 0) 00000100:00100000:3.0:1787784788.573643:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+14:17839:x1874627750180480:12345-0@lo:101:mount.lustre.0 Request processed in 96us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784788.573649:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787784788.573740:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784788.573753:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.573760:0:17839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784788.573812:0:17839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787784788.573819:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.573835:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784788.573841:0:17839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787784788.573844:0:17839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784788.573849:0:17839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8950c4020000 10000000:01000000:2.0:1787784788.573852:0:17839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787784788.573855:0:17839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787784788.573858:0:17839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787784788.573875:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.573881:0:17839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.573888:0:17839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784788.573902:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180608:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784788.573931:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784788.573952:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fabce180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784788.574170:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750180608 00000100:00100000:3.0:1787784788.574174:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750180608 00000100:00100000:3.0:1787784788.574193:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787784788.574199:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+14:17839:x1874627750180608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784788.574205:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784788.574218:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3712e00/0x88ace7295d9dfb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9dfae expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.574232:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3712e00/0x88ace7295d9dfb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9dfae expref: 15 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.574241:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3712e00/0x88ace7295d9dfb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9dfae expref: 15 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.574247:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712e00, rc 0) 00000100:00100000:3.0:1787784788.574281:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+15:17839:x1874627750180608:12345-0@lo:101:mount.lustre.0 Request processed in 82us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784788.574287:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787784788.575927:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784788.575952:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.575976:0:17839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784788.577226:0:17839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1787784788.578191:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784788.588084:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787784788.588147:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787784788.588164:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787784788.588176:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787784788.588193:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1787784788.588207:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1787784788.588221:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1787784788.588235:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787784788.588246:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787784788.588257:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1787784788.588270:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1787784788.588281:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1787784788.588297:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1787784788.588310:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787784788.588323:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787784788.588352:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1787784788.588366:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787784788.588378:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787784788.588392:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1787784788.588405:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787784788.588417:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787784788.588429:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1787784788.588442:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1787784788.588473:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1787784788.588479:0:17839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1787784788.588588:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784788.588650:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784788.588702:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8380480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784788.588884:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750180736 00000100:00100000:0.0:1787784788.588891:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750180736 00000100:00100000:0.0:1787784788.588948:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787784788.588958:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+15:17839:x1874627750180736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784788.589110:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+15:17839:x1874627750180736:12345-0@lo:501:mount.lustre.0 Request processed in 154us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784788.589119:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787784788.589562:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784788.589597:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784788.589640:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784788.589704:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8380480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784788.596738:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750180864 00000100:00100000:0.0:1787784788.596756:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750180864 00000100:00100000:0.0:1787784788.596844:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787784788.596855:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+15:17839:x1874627750180864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784788.598035:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+15:17839:x1874627750180864:12345-0@lo:503:mount.lustre.0 Request processed in 1175us (8387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784788.598047:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784788.598269:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180864:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787784788.598740:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784788.598874:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784788.598926:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784788.598976:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c343be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784788.599452:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750180992 00000100:00100000:0.0:1787784788.599458:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750180992 00000100:00100000:0.0:1787784788.599494:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787784788.599503:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+15:17839:x1874627750180992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784788.600222:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+15:17839:x1874627750180992:12345-0@lo:502:mount.lustre.0 Request processed in 718us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784788.600231:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787784788.600457:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750180992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784788.600709:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787784788.600742:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1787784788.600755:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1787784788.600800:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1787784788.600819:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1787784788.600833:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1787784788.600845:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1787784788.600860:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1787784788.600873:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1787784788.600886:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1787784788.600911:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1787784788.600927:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1787784788.600941:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1787784788.601092:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1787784788.601118:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1787784788.601136:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1787784788.601149:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1787784788.601163:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1787784788.601176:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1787784788.601189:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1787784788.601201:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1787784788.601212:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1787784788.601223:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1787784788.601237:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1787784788.601250:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1787784788.601262:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1787784788.601273:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1787784788.601286:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1787784788.601298:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1787784788.601404:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1787784788.601422:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1787784788.601435:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1787784788.601448:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1787784788.601459:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1787784788.601470:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1787784788.601483:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1787784788.601496:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1787784788.601509:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1787784788.601523:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1787784788.601536:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1787784788.601548:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1787784788.601560:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1787784788.601573:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1787784788.601596:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1787784788.601635:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750181120:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784788.601701:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784788.601742:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c343be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784788.601966:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750181120 00000100:00100000:0.0:1787784788.601974:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750181120 00000100:00100000:0.0:1787784788.602213:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787784788.602223:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+15:17839:x1874627750181120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784788.602484:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+15:17839:x1874627750181120:12345-0@lo:502:mount.lustre.0 Request processed in 262us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784788.602493:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787784788.602753:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750181120:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784788.602871:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1787784788.602883:0:17839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1787784788.604263:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784788.604288:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784788.604291:0:17843:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787784788.604297:0:17843:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787784788.604301:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784788.604464:0:17843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8951fb388000) 00000020:00000080:3.0:1787784788.604487:0:17843:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1787784788.604494:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787784788.604589:0:17843:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787784788.604597:0:17843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9dfc3 00000020:00000080:3.0:1787784788.605100:0:17843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787784788.605107:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784788.605111:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784788.605113:0:17843:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787784788.605117:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784788.605121:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784788.605122:0:17843:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787784788.605126:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784788.605133:0:17843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8951fb3899b8) 00000020:00000080:3.0:1787784788.605147:0:17843:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1787784788.605151:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787784788.605153:0:17843:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787784788.605156:0:17843:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787784788.605161:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787784788.605221:0:17843:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8950c4020000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787784788.605232:0:17843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8951fb38b370) 00000020:00000080:3.0:1787784788.605240:0:17843:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1787784788.605576:0:17843:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787784788.605582:0:17843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9dfd8 00000020:00000080:3.0:1787784788.605713:0:17843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787784788.605720:0:17843:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787784788.605724:0:17843:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x88ace7295d9dfdf 00080000:01000000:3.0:1787784788.605730:0:17843:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787784788.605732:0:17843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9dfe6 00000100:00100000:0.0:1787784788.615008:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00010000:00010000:3.0:1787784788.693751:0:17843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1787784788.694520:0:17843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1787784788.694886:0:17843:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787784788.696100:0:17843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787784788.696112:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784788.696118:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784788.696121:0:17843:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787784788.696124:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784788.696130:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784788.696132:0:17843:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787784788.696135:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787784788.696140:0:17843:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:00000080:3.0:1787784788.696166:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784788.696181:0:17843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8951fb38cd28) 00000020:00000080:3.0:1787784788.696211:0:17843:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787784788.696218:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787784788.696288:0:17843:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787784788.696296:0:17843:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787784788.696301:0:17843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9dff4 00010000:00080000:3.0:1787784788.696571:0:17843:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951cfe93800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1787784788.701392:0:17843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1787784788.708638:0:17843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787784788.708655:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787784788.708703:0:17843:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787784788.708724:0:17843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9dffb 00000100:00080000:0.0:1787784788.708733:0:17843:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784788.708739:0:17843:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8951cfe93800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784788.708782:0:17843:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47c780 x1874627750181248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784788.708830:0:17843:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787784788.709046:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750181248:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787784788.709142:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784788.709219:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750181248 00000100:00100000:3.0:1787784788.709225:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750181248 00000100:00100000:3.0:1787784788.709258:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784788.709265:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750181248:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787784788.709289:0:17112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:3.0:1787784788.709360:0:17112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9e002 00000004:00100000:3.0:1787784788.709375:0:17112:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787784788.709380:0:17112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787784788.709742:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787784788.709747:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787784788.709750:0:37:0:(import.c:65:import_set_state_nolock()) ffff8951eff2a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784788.709755:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:0.0:1787784788.709758:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787784788.709763:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8951eff2a800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784788.709805:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47f840 x1874627750181376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784788.709824:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784788.709828:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784788.709830:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784788.709832:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787784788.709958:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750181376:0@lo:38:kworker.0 00000100:00100000:2.0:1787784788.710009:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.710145:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784788.710156:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750181504:0@lo:400:kworker.0 00000100:00100000:0.0:1787784788.710185:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.710217:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750181504 00000100:00100000:0.0:1787784788.710222:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750181504 00000100:00100000:0.0:1787784788.710259:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784788.710266:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750181504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784788.710505:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750181504:12345-0@lo:400:kworker.0 Request processed in 238us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784788.710512:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:0.0:1787784788.710590:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784788.710595:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.710597:0:17843:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787784788.710600:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787784788.710603:0:17843:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787784788.710604:0:17843:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784788.710605:0:17843:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784788.710606:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787784788.710608:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.710609:0:17843:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787784788.710611:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784788.710615:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.710616:0:17843:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787784788.710620:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787784788.710663:0:17843:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787784788.710676:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784788.710680:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.710681:0:17843:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787784788.710684:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787784788.710686:0:17843:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1787784788.710687:0:17843:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784788.710696:0:17843:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784788.710698:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787784788.710701:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.710702:0:17843:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787784788.710704:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787784788.710708:0:17843:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787784788.710711:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.710712:0:17843:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787784788.710715:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787784788.710718:0:17843:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:0.0:1787784788.710740:0:17843:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787784788.710743:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784788.710756:0:17843:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8950c20c8000) 00000020:00000080:0.0:1787784788.710789:0:17843:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787784788.710796:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787784788.710879:0:17843:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787784788.710886:0:17843:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787784788.710894:0:17843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9e010 00010000:00080000:0.0:1787784788.710931:0:17843:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951c2cc4800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1787784788.711151:0:17843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00010000:00080000:2.0:1787784788.712964:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8951ff47c000 x1874627750181504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784788.712982:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750181504:0@lo:400:kworker.0 00000100:00100000:1.0:1787784788.713571:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750181376 00000100:00100000:1.0:1787784788.713578:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750181376 00000100:00100000:1.0:1787784788.713606:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784788.713731:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3271e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874627750181376:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787784788.713985:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3271e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874627750181376:12345-0@lo:38:kworker.0 Request processed in 256us (3974us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787784788.714002:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784788.714062:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784788.714070:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951eff2a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784788.714077:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787784788.714080:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750181376:0@lo:38:kworker.0 00000100:00080000:2.0:1787784788.714554:0:17112:0:(import.c:65:import_set_state_nolock()) ffff8951c2ce3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784788.714736:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1874627750181248:12345-0@lo:38:llog_process_th.0 Request processed in 5469us (5593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.714750:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:01000000:2.0:1787784788.715541:0:17843:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787784788.715746:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787784788.715756:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787784788.715764:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000040:01000000:2.0:1787784788.715765:0:17843:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1787784788.715853:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787784788.715856:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe93800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787784788.715911:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750181248:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784788.716013:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750181632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784788.716070:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784788.716111:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750181632 00000100:00100000:2.0:1787784788.716118:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750181632 00000100:00100000:2.0:1787784788.716159:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784788.716167:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1874627750181632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787784788.716193:0:17623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787784788.716756:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1874627750181632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 588us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.716790:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784788.717002:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750181632:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787784788.717698:0:17843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787784788.718341:0:17843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787784788.719213:0:17843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1787784788.720189:0:17848:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787784788.720194:0:17848:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787784788.721844:0:17843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787784788.721863:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787784788.721905:0:17843:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787784788.721927:0:17843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9e017 00000100:00080000:0.0:1787784788.721938:0:17843:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784788.721944:0:17843:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8951c2cc4800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784788.721976:0:17843:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47c780 x1874627750181760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784788.722001:0:17843:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1787784788.722099:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750181760:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787784788.722167:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750181760 offset 0 length 520: 4 00000020:01000000:0.0:1787784788.722227:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784788.722231:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.722233:0:17843:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787784788.722237:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787784788.722239:0:17843:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1787784788.722240:0:17843:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784788.722242:0:17843:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784788.722243:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787784788.722245:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.722246:0:17843:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787784788.722248:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787784788.722252:0:17843:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787784788.722255:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.722257:0:17843:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787784788.722260:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787784788.722263:0:17843:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:0.0:1787784788.722283:0:17843:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787784788.722285:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784788.722296:0:17843:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8950c20ccd28) 00000020:00000080:0.0:1787784788.722308:0:17843:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1787784788.722313:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787784788.722387:0:17843:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787784788.722397:0:17843:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787784788.722407:0:17843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9e025 00010000:00080000:0.0:1787784788.722437:0:17843:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951cfe44000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1787784788.722717:0:17843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787784788.722808:0:17843:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787784788.722824:0:17843:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1787784788.723781:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784788.723788:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784788.723791:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784788.723793:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1787784788.727345:0:17843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787784788.727702:0:17843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787784788.727867:0:17843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787784788.728457:0:17850:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787784788.728462:0:17850:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787784788.729607:0:17843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787784788.729810:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787784788.729857:0:17843:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787784788.729881:0:17843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9e02c 00000100:00080000:0.0:1787784788.729891:0:17843:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784788.729897:0:17843:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8951cfe44000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784788.729932:0:17843:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47e1c0 x1874627750181888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784788.729960:0:17843:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787784788.730076:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784788.730081:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784788.730084:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784788.730086:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1787784788.730165:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784788.730169:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.730171:0:17843:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787784788.730173:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784788.730177:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.730178:0:17843:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787784788.730182:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787784788.730183:0:17843:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787784788.730185:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784788.730187:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.730189:0:17843:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787784788.730191:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784788.730193:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.730194:0:17843:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787784788.730197:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787784788.730237:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784788.730241:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.730242:0:17843:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787784788.730246:0:17843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00100000:2.0:1787784788.730355:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750181888:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787784788.730425:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750181888 offset 0 length 520: 4 00000020:01000000:1.0:1787784788.730565:0:17839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1787784788.730596:0:17839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787784788.730631:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.730643:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784788.730652:0:17839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8950c4020000 from 1 10000000:01000000:1.0:1787784788.730655:0:17839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787784788.730685:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.730702:0:17839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.730713:0:17839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784788.730729:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787784788.730793:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784788.730815:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23300 going to sleep for 11 seconds 00000100:00100000:0.0:1787784788.730974:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750182016 00000100:00100000:0.0:1787784788.730988:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750182016 00000100:00100000:0.0:1787784788.731029:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784788.731037:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+15:17839:x1874627750182016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784788.731048:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784788.731059:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1629600/0x88ace7295d9e03a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e033 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.731079:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629600/0x88ace7295d9e03a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e033 expref: 16 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.731090:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1629600/0x88ace7295d9e03a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e033 expref: 16 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.731098:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629600, rc 0) 00000100:00100000:0.0:1787784788.731143:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+16:17839:x1874627750182016:12345-0@lo:101:mount.lustre.0 Request processed in 106us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784788.731149:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784788.731185:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784788.731196:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e03a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.731205:0:17839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e03a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784788.731735:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182144:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787784788.731797:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.731823:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33550c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784788.731826:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750182144 00000100:00100000:2.0:1787784788.731831:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750182144 00000100:00100000:2.0:1787784788.731872:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787784788.731880:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+16:17839:x1874627750182144:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787784788.731893:0:17101:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787784788.731908:0:17101:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787784788.731911:0:17101:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787784788.731997:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+16:17839:x1874627750182144:12345-0@lo:256:mount.lustre.0 Request processed in 118us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.732005:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787784788.732292:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182144:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787784788.733711:0:17839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787784788.733745:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e03a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.733757:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e03a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784788.733766:0:17839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8950c4020000 from 1 10000000:01000000:0.0:1787784788.733789:0:17839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784788.733822:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.733830:0:17839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.733840:0:17839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784788.733862:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787784788.733918:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.734099:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33550c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784788.734468:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750182272 00000100:00100000:1.0:1787784788.734476:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750182272 00000100:00100000:1.0:1787784788.734566:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784788.734575:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+16:17839:x1874627750182272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784788.734587:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784788.734600:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df602a00/0x88ace7295d9e048 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e041 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.734633:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602a00/0x88ace7295d9e048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e041 expref: 17 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.734644:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df602a00/0x88ace7295d9e048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e041 expref: 17 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.734653:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602a00, rc 0) 00000100:00100000:1.0:1787784788.734704:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17839:x1874627750182272:12345-0@lo:101:mount.lustre.0 Request processed in 130us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784788.734711:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787784788.734812:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784788.734826:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e048 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.734844:0:17839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e048 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784788.734963:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787784788.735005:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784788.735036:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.735463:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355300 going to sleep for 11 seconds 00000100:00100000:2.0:1787784788.735527:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750182400 00000100:00100000:2.0:1787784788.735531:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750182400 00000100:00100000:2.0:1787784788.735558:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787784788.735566:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17839:x1874627750182400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784788.735741:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17839:x1874627750182400:12345-0@lo:501:mount.lustre.0 Request processed in 175us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.735758:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787784788.735924:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784788.735953:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784788.736073:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.736217:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355300 going to sleep for 11 seconds 00000100:00100000:2.0:1787784788.736373:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750182528 00000100:00100000:2.0:1787784788.736379:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750182528 00000100:00100000:2.0:1787784788.736449:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787784788.736457:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17839:x1874627750182528:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784788.737440:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17839:x1874627750182528:12345-0@lo:503:mount.lustre.0 Request processed in 978us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.737450:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784788.737721:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182528:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787784788.738271:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787784788.738358:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784788.738422:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.738516:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33550c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784788.738667:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750182656 00000100:00100000:2.0:1787784788.738674:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750182656 00000100:00100000:2.0:1787784788.738711:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787784788.738721:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17839:x1874627750182656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784788.738851:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17839:x1874627750182656:12345-0@lo:502:mount.lustre.0 Request processed in 131us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.738859:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787784788.738968:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787784788.739305:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787784788.739341:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1787784788.739357:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1787784788.739370:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1787784788.739383:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1787784788.739413:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1787784788.739429:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1787784788.739442:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1787784788.739465:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787784788.739477:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1787784788.739489:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1787784788.739511:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784788.739549:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.739856:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33550c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784788.739955:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750182784 00000100:00100000:2.0:1787784788.739961:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750182784 00000100:00100000:2.0:1787784788.740001:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787784788.740009:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17839:x1874627750182784:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784788.740102:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17839:x1874627750182784:12345-0@lo:502:mount.lustre.0 Request processed in 94us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784788.740275:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787784788.740323:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1787784788.740341:0:17839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787784788.740590:0:17852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784788.740599:0:17852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.740602:0:17852:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787784788.740609:0:17852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8950c4020000 00000020:00000080:0.0:1787784788.740624:0:17852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787784788.740634:0:17852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784788.740636:0:17852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.740638:0:17852:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787784788.740641:0:17852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784788.740643:0:17852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.740644:0:17852:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787784788.740647:0:17852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8950c4020000 00000020:00000080:0.0:1787784788.740649:0:17852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787784788.740699:0:17852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784788.740703:0:17852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.740704:0:17852:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787784788.740706:0:17852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784788.740709:0:17852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.740710:0:17852:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787784788.740713:0:17852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8950c4020000 00000020:00000080:0.0:1787784788.740715:0:17852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787784788.740730:0:17852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784788.740738:0:17852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.740740:0:17852:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787784788.740742:0:17852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784788.740744:0:17852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.740745:0:17852:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787784788.740748:0:17852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8950c4020000 00000020:00000080:0.0:1787784788.740750:0:17852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787784788.740800:0:17852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784788.740804:0:17852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784788.740806:0:17852:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787784788.740809:0:17852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1787784788.740840:0:17839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787784788.740860:0:17839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787784788.740877:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e048 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.740889:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e048 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784788.740937:0:17839:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787784788.740940:0:17839:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8950c4020000 10000000:01000000:0.0:1787784788.740943:0:17839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8950c4020000 10000000:01000000:0.0:1787784788.740947:0:17839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787784788.740951:0:17839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8950c4020000 from 1 10000000:01000000:0.0:1787784788.740954:0:17839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787784788.740994:0:17839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.741003:0:17839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.741013:0:17839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784788.741035:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787784788.741074:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.741097:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33553c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784788.741535:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787784788.741576:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750182912 00000100:00100000:2.0:1787784788.741581:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750182912 00000100:00100000:2.0:1787784788.741607:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787784788.741667:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17839:x1874627750182912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784788.741684:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784788.741697:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c4183800/0x88ace7295d9e056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e04f expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.741719:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c4183800/0x88ace7295d9e056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e04f expref: 18 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.741729:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c4183800/0x88ace7295d9e056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e04f expref: 18 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.741737:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183800, rc 0) 00000100:00100000:2.0:1787784788.741801:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17839:x1874627750182912:12345-0@lo:101:mount.lustre.0 Request processed in 187us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.741808:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784788.742735:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750182912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784788.742755:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784788.742792:0:17839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784788.744759:0:17839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787784788.745509:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787784788.747252:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1787784788.747307:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1787784788.747352:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1787784788.747368:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1787784788.747383:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1787784788.747396:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1787784788.747408:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1787784788.747421:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1787784788.747433:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1787784788.747443:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1787784788.747455:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1787784788.749241:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1787784788.749282:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1787784788.749294:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1787784788.749305:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1787784788.749315:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1787784788.749336:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1787784788.749359:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1787784788.749382:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1787784788.749393:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1787784788.749404:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1787784788.749414:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1787784788.749425:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1787784788.749440:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1787784788.749450:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1787784788.749461:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1787784788.749690:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1787784788.749703:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1787784788.749724:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1787784788.749729:0:17839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787784788.749845:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750183040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784788.749906:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.749942:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784788.750223:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750183040 00000100:00100000:2.0:1787784788.750230:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750183040 00000100:00100000:2.0:1787784788.750281:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787784788.750289:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17839:x1874627750183040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784788.751848:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17839:x1874627750183040:12345-0@lo:501:mount.lustre.0 Request processed in 1554us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.751860:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787784788.751969:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750183040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784788.752014:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750183168:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784788.752061:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.752100:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784788.753506:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750183168 00000100:00100000:2.0:1787784788.753518:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750183168 00000100:00100000:2.0:1787784788.753567:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787784788.753576:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17839:x1874627750183168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784788.753887:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17839:x1874627750183168:12345-0@lo:503:mount.lustre.0 Request processed in 311us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.753903:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784788.755306:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750183168:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787784788.755905:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787784788.755985:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750183296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784788.756049:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.756086:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784788.759251:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750183296 00000100:00100000:2.0:1787784788.759263:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750183296 00000100:00100000:2.0:1787784788.759317:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787784788.759336:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17839:x1874627750183296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784788.759500:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17839:x1874627750183296:12345-0@lo:502:mount.lustre.0 Request processed in 174us (3449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.759507:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787784788.760528:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750183296:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787784788.760812:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787784788.760852:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1787784788.760885:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1787784788.760899:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1787784788.760911:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1787784788.760923:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1787784788.760934:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1787784788.760945:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1787784788.760956:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1787784788.760967:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1787784788.760978:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1787784788.761005:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1787784788.761019:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1787784788.761030:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1787784788.761043:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1787784788.761056:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1787784788.761068:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1787784788.761081:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1787784788.761108:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1787784788.761212:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1787784788.761226:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1787784788.761239:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1787784788.761252:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1787784788.761268:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1787784788.761281:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1787784788.761295:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1787784788.761309:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1787784788.761323:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1787784788.761350:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1787784788.761365:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1787784788.761375:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1787784788.761387:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1787784788.761400:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1787784788.761414:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1787784788.761449:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1787784788.761471:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1787784788.761485:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1787784788.761498:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1787784788.761510:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1787784788.761522:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1787784788.761533:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1787784788.761544:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1787784788.761556:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1787784788.761569:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1787784788.761581:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1787784788.761593:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1787784788.761604:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1787784788.761615:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1787784788.761662:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750183424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784788.761727:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.761800:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784788.762319:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750183424 00000100:00100000:3.0:1787784788.762335:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750183424 00000100:00100000:3.0:1787784788.762387:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787784788.762396:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17839:x1874627750183424:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784788.762521:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17839:x1874627750183424:12345-0@lo:502:mount.lustre.0 Request processed in 126us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784788.762528:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787784788.763127:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750183424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784788.763355:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1787784788.763381:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1787784788.763410:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750183552:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784788.763461:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784788.768952:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f0114d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784788.769073:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750183552 00000100:00100000:2.0:1787784788.769082:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750183552 00000100:00100000:2.0:1787784788.769247:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787784788.769257:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17839:x1874627750183552:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784788.769414:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17839:x1874627750183552:12345-0@lo:502:mount.lustre.0 Request processed in 158us (5952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.769422:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787784788.772641:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750183552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784788.772749:0:17839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1787784788.772763:0:17839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787784788.773514:0:17857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787784788.773528:0:17857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff895201d099b8) 00000020:00000080:1.0:1787784788.773547:0:17857:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787784788.773620:0:17857:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8950c4020000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787784788.773624:0:17857:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8950c4020000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787784788.773626:0:17857:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8950c4020000 3 00010000:00080000:1.0:1787784788.773658:0:17857:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951efed9000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1787784788.778554:0:17857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787784788.781339:0:17857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787784788.781403:0:17857:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787784788.781416:0:17857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x88ace7295d9e064 00000100:00080000:3.0:1787784788.781427:0:17857:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787784788.781439:0:17857:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8951efed9000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784788.781475:0:17857:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951f5290b40 x1874627750183680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784788.781501:0:17857:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787784788.783186:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874627750183680:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787784788.783259:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787784788.787247:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787784788.787255:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787784788.787258:0:37:0:(import.c:65:import_set_state_nolock()) ffff8951eff2a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784788.787270:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8951eff2a800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784788.787314:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c3413840 x1874627750183808/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784788.787345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784788.787349:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784788.787351:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784788.787354:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784788.787395:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784788.787398:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784788.787401:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784788.787403:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787784788.787575:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750183680 00000100:00100000:1.0:1787784788.787583:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750183680 00000100:00100000:1.0:1787784788.787623:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784788.787630:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874627750183680:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787784788.787653:0:17109:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:1.0:1787784788.787684:0:17109:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x88ace7295d9e06b 00000004:00100000:1.0:1787784788.787699:0:17109:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787784788.787726:0:17109:0:(import.c:65:import_set_state_nolock()) ffff8951efeda800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784788.787819:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874627750183680:12345-0@lo:38:llog_process_th.0 Request processed in 187us (4559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784788.787826:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784788.787855:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750183808:0@lo:38:kworker.0 00000100:00100000:1.0:1787784788.787891:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787784788.787935:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8951f5290b40 x1874627750183680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784788.787946:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784788.787953:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787784788.787960:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787784788.787964:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787784788.787967:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951efed9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787784788.787973:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874627750183680:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787784788.790732:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750183936:0@lo:400:kworker.0 00000100:00100000:0.0:1787784788.790816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784788.790878:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750183936 00000100:00100000:0.0:1787784788.790886:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750183936 00000100:00100000:0.0:1787784788.790928:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784788.790937:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750183936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784788.791068:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750183936:12345-0@lo:400:kworker.0 Request processed in 131us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784788.791077:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787784788.791184:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8950c3412940 x1874627750183936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784788.791433:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3411e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750184064:0@lo:400:kworker.0 00000100:00100000:1.0:1787784788.791466:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784788.791509:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750183808 00000100:00100000:1.0:1787784788.791513:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750183808 00000100:00100000:1.0:1787784788.791544:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750184064 00000100:00100000:1.0:1787784788.791547:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750184064 00000100:00100000:1.0:1787784788.791564:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784788.791569:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750183808:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787784788.791616:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750183808:12345-0@lo:38:kworker.0 Request processed in 45us (3723us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787784788.791622:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784788.791635:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784788.791641:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3413c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874627750184064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784788.791672:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3413c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874627750184064:12345-0@lo:400:kworker.0 Request processed in 31us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784788.791677:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784788.791714:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3411e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750184064:0@lo:400:kworker.0 00000100:00080000:1.0:1787784788.791743:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951eff2a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784788.791747:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787784788.791751:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750183808:0@lo:38:kworker.0 00000100:00100000:0.0:1787784788.793097:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750183936:0@lo:400:kworker.0 00000040:00080000:0.0:1787784788.800533:0:17857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1787784788.800945:0:17839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787784788.800976:0:17839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787784788.801005:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.801018:0:17839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787784788.801070:0:17839:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787784788.801073:0:17839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787784788.801074:0:17839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784788.801076:0:17839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784788.801081:0:17839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784788.801082:0:17839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784788.801084:0:17839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787784788.801085:0:17839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784788.801086:0:17839:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784788.801090:0:17839:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1787784788.801092:0:17839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787784788.801093:0:17839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787784788.801094:0:17839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784788.801095:0:17839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784788.801096:0:17839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784788.801097:0:17839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784788.801098:0:17839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787784788.801098:0:17839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784788.801099:0:17839:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784788.801282:0:17839:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787784788.801301:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750184192:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787784788.801384:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784788.801422:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784788.801751:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750184192 00000100:00100000:3.0:1787784788.801758:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750184192 00000100:00100000:3.0:1787784788.802741:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787784788.802751:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17839:x1874627750184192:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787784788.802799:0:17102:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787784788.802811:0:17102:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1787784788.808721:0:17087:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787784788.808823:0:17102:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787784788.808840:0:17102:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787784788.809051:0:17123:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787784788.809056:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787784788.809075:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.809094:0:17123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951d1629c00/0x88ace7295d9df76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9df6f expref: 18 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.809101:0:17123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951d1629600/0x88ace7295d9e03a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e033 expref: 18 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.809107:0:17123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.809156:0:17123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951d1629600/0x88ace7295d9e03a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e033 expref: 18 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.809169:0:17123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951d1629600/0x88ace7295d9e03a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e033 expref: 18 pid: 17100 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784788.809210:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5290b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750184320:0@lo:104: 00000100:00100000:3.0:1787784788.809276:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784788.809347:0:17123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951d1629c00/0x88ace7295d9df76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9df6f expref: 18 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784788.809355:0:17123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951d1629c00/0x88ace7295d9df76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9df6f expref: 18 pid: 17101 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784788.809364:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750184448:0@lo:104: 00000100:00100000:3.0:1787784788.809386:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784788.809402:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f0114240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784788.809678:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17839:x1874627750184192:12345-0@lo:253:mount.lustre.0 Request processed in 6927us (8292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.809688:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787784788.809834:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750184320 00000100:00100000:2.0:1787784788.809840:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750184320 00000100:00100000:2.0:1787784788.809869:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750184448 00000100:00100000:2.0:1787784788.809871:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750184448 00000100:00100000:2.0:1787784788.809895:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784788.809902:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5293840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+4:17123:x1874627750184320:12345-0@lo:104: 00010000:00010000:2.0:1787784788.809914:0:17091:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e03a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.809957:0:17091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784788.809963:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5293840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+4:17123:x1874627750184320:12345-0@lo:104: Request processed in 62us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.809969:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784788.809992:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784788.810001:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+3:17123:x1874627750184448:12345-0@lo:104: 00010000:00010000:2.0:1787784788.810010:0:17091:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9df76 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.810040:0:17091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787784788.810045:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+3:17123:x1874627750184448:12345-0@lo:104: Request processed in 47us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784788.810051:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787784788.810066:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784788.810071:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e03a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.810077:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784788.810080:0:17095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e03a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.810088:0:17095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e03a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784788.810103:0:17095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e03a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784788.810376:0:17095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784788.810406:0:17095:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e03a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.810413:0:17095:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784788.810438:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e03a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.810444:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9e033 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e03a expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.810455:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784788.810458:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9df76 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.810464:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628e00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784788.810467:0:17095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9df76 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.810473:0:17095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9df76 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784788.810479:0:17095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9df76 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784788.810484:0:17095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784788.810502:0:17095:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9df76 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.810508:0:17095:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787784788.810583:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:17839:1874627750184192:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787784788.810594:0:17839:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787784788.810598:0:17839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787784788.810599:0:17839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787784788.810601:0:17839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784788.810603:0:17839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784788.810604:0:17839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784788.810605:0:17839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784788.810606:0:17839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784788.810608:0:17839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784788.810610:0:17839:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787784788.810625:0:17839:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787784788.811357:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750184576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784788.811403:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784788.811459:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3271680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750184704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784788.811483:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784788.811514:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750184576 00000100:00100000:1.0:1787784788.811519:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750184576 00010000:00010000:1.0:1787784788.811545:0:17092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951d1629600/0x88ace7295d9e03a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e033 expref: 18 pid: 17100 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784788.811570:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750184704 00000100:00100000:1.0:1787784788.811573:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750184704 00010000:00010000:1.0:1787784788.811583:0:17092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951d1629c00/0x88ace7295d9df76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9df6f expref: 19 pid: 17101 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784788.811596:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784788.811613:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:3647:x1874627750184576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784788.811624:0:17092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784788.811630:0:17092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951d1629600/0x88ace7295d9e03a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e033 expref: 19 pid: 17100 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.811640:0:17092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951d1629600/0x88ace7295d9e03a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e033 expref: 19 pid: 17100 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.811658:0:17092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784788.811689:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:3647:x1874627750184576:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784788.811696:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784788.811712:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784788.811718:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:3644:x1874627750184704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784788.811726:0:17092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784788.811730:0:17092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951d1629c00/0x88ace7295d9df76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9df6f expref: 18 pid: 17101 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.811739:0:17092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951d1629c00/0x88ace7295d9df76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9df6f expref: 18 pid: 17101 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.811751:0:17092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.811760:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787784788.811791:0:17092:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003433733s 00010000:00010000:1.0:1787784788.811796:0:17092:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.811813:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.811819:0:17092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.811825:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.811831:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784788.811834:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.811842:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.811851:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.811860:0:17092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784788.811888:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:3644:x1874627750184704:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784788.811894:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784788.811927:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750184576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784788.811947:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3271680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750184704:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784788.812361:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9df76 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.812370:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1628e00/0x88ace7295d9df6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9df76 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.812386:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784788.812388:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784788.812390:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784788.812434:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629600/0x88ace7295d9e03a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e033 expref: 17 pid: 17100 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784788.812444:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5290b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750184320:0@lo:104: 00010000:00010000:2.0:1787784788.812455:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629c00/0x88ace7295d9df76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9df6f expref: 16 pid: 17101 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784788.812463:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750184448:0@lo:104: 00010000:00010000:2.0:1787784788.812477:0:17123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.812485:0:17123:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.812491:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784788.812497:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3712400/0x88ace7295d9e072 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784788.814549:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787784788.829454:0:17839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1787784788.829580:0:17864:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787784788.829584:0:17864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787784788.829677:0:17865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1787784788.830090:0:17865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787784788.831099:0:17839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787784788.831966:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17866:1874627750184832:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787784788.832046:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1787784788.832048:0:17839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787784788.832095:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787784788.832101:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750184832 00000100:00100000:1.0:1787784788.832109:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750184832 00000100:00100000:1.0:1787784788.832156:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787784788.832164:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17866:x1874627750184832:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787784788.832237:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17866:x1874627750184832:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 74us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784788.832244:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787784788.832268:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784788.832291:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17866:1874627750184832:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787784788.832317:0:17866:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787784788.832352:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17866:1874627750184960:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787784788.832380:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784788.832398:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750184960 00000100:00100000:1.0:1787784788.832401:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750184960 00000100:00100000:1.0:1787784788.832419:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784788.832424:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17866:x1874627750184960:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787784788.832502:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17866:x1874627750184960:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 77us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784788.832508:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784788.832524:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784788.832537:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17866:1874627750184960:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787784788.832580:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17866:1874627750185088:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787784788.832606:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:2.0:1787784788.832714:0:17839:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787784788.832722:0:17839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787784788.832765:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787784788.833864:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750185088 00000100:00100000:1.0:1787784788.833872:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750185088 00000100:00100000:1.0:1787784788.833917:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784788.833936:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17866:x1874627750185088:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787784788.834006:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17866:x1874627750185088:12345-0@lo:900:lod0001_rec0000.0 Request processed in 73us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784788.834013:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784788.834408:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d840 going to sleep for 11 seconds 00010000:00080000:1.0:1787784788.834429:0:17866:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8950c3410000 x1874627750185088/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787784804 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784788.834442:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17866:1874627750185088:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787784788.834498:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17866:1874627750185216:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787784788.834532:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784788.834557:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750185216 00000100:00100000:1.0:1787784788.834560:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750185216 00000100:00100000:1.0:1787784788.834584:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784788.834590:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17866:x1874627750185216:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787784788.835566:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95dcc0 going to sleep for 11 seconds 00000040:00080000:2.0:1787784788.836649:0:17839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1787784788.836707:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17866:x1874627750185216:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 2113us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784788.836718:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000040:00080000:0.0:1787784788.837228:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787784788.837274:0:17865:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1787784788.837612:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17866:1874627750185216:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787784788.837673:0:17866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784788.839236:0:17839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787784788.839295:0:17839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787784788.839522:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787784788.841066:0:17839:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1787784788.843478:0:17866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787784788.843544:0:17866:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787784788.843549:0:17866:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1787784788.844521:0:17839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787784788.857288:0:17839:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787784788.857343:0:17839:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb77a01c77988 00100000:10000000:2.0:1787784788.857352:0:17839:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1787784788.858672:0:17839:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787784788.858708:0:17839:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787784788.858727:0:17839:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787784788.858753:0:17839:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787784788.865576:0:17839:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787784788.865849:0:17839:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787784789.061881:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784789.637877:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00000040:00080000:1.0:1787784789.834726:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784790.087422:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787784790.087469:0:17104:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787784790.087474:0:17104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8950c4020000 from 8 10000000:01000000:0.0:1787784790.087481:0:17104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787784790.087536:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.087548:0:17104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.087561:0:17104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784790.087592:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750185344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784790.087696:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784790.087750:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784790.089848:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750185344 00000100:00100000:2.0:1787784790.089865:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750185344 00000100:00100000:2.0:1787784790.089932:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787784790.089945:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+16:17104:x1874627750185344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784790.089966:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784790.090001:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c4183400/0x88ace7295d9e080 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e079 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.090037:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c4183400/0x88ace7295d9e080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e079 expref: 17 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.090050:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c4183400/0x88ace7295d9e080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e079 expref: 17 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.090069:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183400, rc 0) 00000100:00100000:2.0:1787784790.090158:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17104:x1874627750185344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (2461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784790.090165:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787784790.090250:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750185344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784790.090271:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e080 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.090282:0:17104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e080 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784790.090368:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3271a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750185472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787784790.090413:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784790.090449:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784790.090467:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750185472 00000100:00100000:2.0:1787784790.090471:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750185472 00000100:00100000:2.0:1787784790.090496:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787784790.090502:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17104:x1874627750185472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787784790.090517:0:17102:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787784790.090535:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787784790.090539:0:17102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787784790.090628:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17104:x1874627750185472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784790.090635:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787784790.090679:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3271a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750185472:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787784790.090747:0:17104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787784790.090756:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e080 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.090793:0:17104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e080 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784790.090807:0:17104:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787784790.090810:0:17104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951fb22c000 from 8 10000000:01000000:2.0:1787784790.090813:0:17104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787784790.090838:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.090846:0:17104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.090855:0:17104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784790.090869:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3271a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750185600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784790.090898:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784790.090913:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784790.090926:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750185600 00000100:00100000:2.0:1787784790.090929:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750185600 00000100:00100000:2.0:1787784790.090953:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787784790.090959:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17104:x1874627750185600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784790.090967:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784790.090979:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c4183200/0x88ace7295d9e08e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e087 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.091009:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c4183200/0x88ace7295d9e08e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e087 expref: 18 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.091019:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c4183200/0x88ace7295d9e08e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e087 expref: 18 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.091027:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183200, rc 0) 00000100:00100000:2.0:1787784790.091058:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17104:x1874627750185600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784790.091065:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787784790.091095:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3271a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750185600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784790.091106:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e08e expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.091115:0:17104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e08e expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784790.091155:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3271a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750185728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787784790.091183:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784790.091195:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784790.091206:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750185728 00000100:00100000:2.0:1787784790.091209:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750185728 00000100:00100000:2.0:1787784790.091226:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787784790.091232:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17104:x1874627750185728:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787784790.091242:0:17100:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787784790.091253:0:17100:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787784790.091260:0:17100:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787784790.091330:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17104:x1874627750185728:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784790.091337:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787784790.091366:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3271a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750185728:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787784790.091400:0:17104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787784790.091405:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e08e expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.091413:0:17104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e08e expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784790.663386:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00000040:00080000:0.0:1787784790.857266:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787784791.111093:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784791.694499:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00010000:00010000:2.0:1787784792.133983:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784792.709857:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00000001:02000400:1.0:1787784792.964475:0:18108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787784793.165034:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784793.735493:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750185856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787784793.735601:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784793.735663:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750185856 00000100:00100000:3.0:1787784793.735671:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750185856 00000100:00100000:3.0:1787784793.735720:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787784793.735731:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750185856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784793.735764:0:17112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787784793.735841:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750185856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784793.735847:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787784793.735884:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750185856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784793.736810:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 0 seconds 00000020:00000004:3.0:1787784793.908351:0:18161:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787784793.909119:0:18161:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787784794.182437:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787784794.246026:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787784794.246043:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787784794.246047:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951eff2a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784794.246059:0:15021:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8951eff2a800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784794.246083:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c3413840 x1874627750186112/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784794.246103:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784794.246106:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784794.246109:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784794.246112:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784794.246136:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784794.246139:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784794.246141:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784794.246144:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787784794.246178:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750186112:0@lo:38:kworker.0 00000100:00100000:1.0:1787784794.246256:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784794.246332:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750186368:0@lo:400:kworker.0 00000100:00100000:1.0:1787784794.246370:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784794.246394:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784794.246399:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750186496:0@lo:400:kworker.0 00000100:00100000:1.0:1787784794.246422:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784794.246458:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750186112 00000100:00100000:1.0:1787784794.246465:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750186112 00000100:00100000:1.0:1787784794.246533:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750186368 00000100:00100000:1.0:1787784794.246543:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750186368 00000100:00100000:1.0:1787784794.246571:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784794.246578:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750186112:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787784794.246604:0:17113:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:1.0:1787784794.246636:0:17113:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9e095 00000004:00100000:1.0:1787784794.246650:0:17113:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787784794.246656:0:17113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1787784794.246733:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784794.246742:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750186368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784794.246814:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750186368:12345-0@lo:400:kworker.0 Request processed in 73us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784794.246820:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784794.246840:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750186496 00000100:00100000:1.0:1787784794.246843:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750186496 00000100:00100000:1.0:1787784794.246883:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784794.246889:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750186496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784794.246917:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750186496:12345-0@lo:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784794.246923:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787784794.246959:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8950c3412580 x1874627750186496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784794.246971:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750186496:0@lo:400:kworker.0 00000100:00100000:1.0:1787784794.246980:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750186368:0@lo:400:kworker.0 00000100:00100000:2.0:1787784794.250347:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750185984:0@lo:400:kworker.0 00000100:00100000:2.0:1787784794.250557:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784794.250624:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784794.250633:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750186240:0@lo:400:kworker.0 00000100:00100000:2.0:1787784794.250659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784794.251509:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750185984 00000100:00100000:3.0:1787784794.251519:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750185984 00000100:00100000:3.0:1787784794.251571:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787784794.251580:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:3646:x1874627750185984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784794.251648:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:3646:x1874627750185984:12345-0@lo:400:kworker.0 Request processed in 68us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784794.251655:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787784794.251722:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750185984:0@lo:400:kworker.0 00000100:00100000:1.0:1787784794.251819:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750186240 00000100:00100000:1.0:1787784794.251824:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750186240 00000100:00100000:1.0:1787784794.251873:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784794.251880:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750186240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784794.251923:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750186240:12345-0@lo:400:kworker.0 Request processed in 45us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784794.251930:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787784794.252042:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8950c3412940 x1874627750186240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784794.252054:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750186240:0@lo:400:kworker.0 00000100:00080000:0.0:1787784794.267427:0:17113:0:(import.c:65:import_set_state_nolock()) ffff8951c85a5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784794.267545:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1874627750186112:12345-0@lo:38:kworker.0 Request processed in 20964us (21287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784794.267557:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787784794.267742:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787784794.267751:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787784794.267757:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787784794.267761:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951eff2a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787784794.267809:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cbb1ea66): req@ffff8951f5291a40 x1874627750178688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784794.267828:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750186112:0@lo:38:kworker.0 00000100:00100000:1.0:1787784794.267897:0:17148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784794.267921:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784794.267937:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750178688 00000100:00100000:1.0:1787784794.267942:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750178688 00000100:00100000:1.0:1787784794.267977:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784794.267985:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17148:x1874627750178688:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787784794.268052:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17148:x1874627750178688:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784794.268060:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784794.268087:0:17148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17148:1874627750178688:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787784794.268130:0:17148:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787784794.268168:0:17148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17148:1874627750186624:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787784794.268197:0:17148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784794.268222:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784794.268232:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750186624 00000100:00100000:1.0:1787784794.268235:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750186624 00000100:00100000:1.0:1787784794.268255:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784794.268261:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17148:x1874627750186624:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787784794.268356:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17148:x1874627750186624:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784794.268362:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784794.268382:0:17148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17148:1874627750186624:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787784794.268438:0:17148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17148:1874627750186752:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787784794.268458:0:17148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784794.268470:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784794.268480:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750186752 00000100:00100000:1.0:1787784794.268483:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750186752 00000100:00100000:1.0:1787784794.268500:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787784794.268506:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17148:x1874627750186752:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787784794.268549:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17148:x1874627750186752:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 42us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784794.268555:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787784794.268576:0:17148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17148:1874627750186752:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787784794.268728:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784794.268737:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750186880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784794.268789:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787784794.269578:0:17148:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787784794.272145:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750186880 00000100:00100000:0.0:1787784794.272159:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750186880 00000100:00100000:0.0:1787784794.272225:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787784794.272234:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750186880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784794.272272:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787784794.272376:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750186880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (3607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784794.272383:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787784794.272436:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750186880:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787784794.274265:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787784794.274753:0:17148:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1787784794.274760:0:17148:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1787784795.009322:0:18211:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787784795.009505:0:18211:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787784795.207250:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787784796.207472:0:18259:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4510d660 20000000:00000080:2.0:1787784796.207490:0:18259:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8951d1becc00 uarg=0000000000000000 20000000:01000000:2.0:1787784796.207546:0:18259:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787784796.207552:0:18259:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787784796.207556:0:18259:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787784796.208502:0:18260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1787784796.208670:0:18259:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787784796.217650:0:18259:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787784796.217763:0:18259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784796.218067:0:18259:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8950c4183000/0x88ace7295d9df45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9df3e expref: 17 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784796.218087:0:18259:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951df602a00/0x88ace7295d9e048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e041 expref: 17 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784796.218095:0:18259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784796.218157:0:18259:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951df602a00/0x88ace7295d9e048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e041 expref: 17 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784796.218173:0:18259:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951df602a00/0x88ace7295d9e048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e041 expref: 17 pid: 17102 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784796.218189:0:18259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32712c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18259:1874627750187008:0@lo:104: 00000100:00100000:2.0:1787784796.218278:0:18259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787784796.218331:0:18259:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8950c4183000/0x88ace7295d9df45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9df3e expref: 17 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784796.218340:0:18259:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8950c4183000/0x88ace7295d9df45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9df3e expref: 17 pid: 17101 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784796.218348:0:18259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18259:1874627750187136:0@lo:104: 00000100:00100000:2.0:1787784796.218369:0:18259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784796.218398:0:18259:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784796.218632:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750187008 00000100:00100000:0.0:1787784796.218640:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750187008 00000100:00100000:0.0:1787784796.218679:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750187136 00000100:00100000:0.0:1787784796.218682:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750187136 00000100:00100000:0.0:1787784796.218696:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784796.218704:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+4:18259:x1874627750187008:12345-0@lo:104: 00010000:00010000:0.0:1787784796.218716:0:17090:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e048 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.218799:0:17090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784796.218806:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+4:18259:x1874627750187008:12345-0@lo:104: Request processed in 103us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784796.218822:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784796.218840:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784796.218846:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+3:18259:x1874627750187136:12345-0@lo:104: 00010000:00010000:0.0:1787784796.218854:0:17090:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9df45 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.218887:0:17090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787784796.218893:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+3:18259:x1874627750187136:12345-0@lo:104: Request processed in 47us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784796.218900:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787784796.218916:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784796.218922:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e048 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.218929:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784796.218934:0:17095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e048 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.218943:0:17095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e048 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784796.218950:0:17095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e048 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784796.218955:0:17095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784796.218982:0:17095:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e048 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.218988:0:17095:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784796.219011:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e048 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219019:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e041 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e048 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219032:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784796.219035:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9df45 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219041:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183600 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784796.219044:0:17095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9df45 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219051:0:17095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9df45 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784796.219058:0:17095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9df45 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784796.219063:0:17095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784796.219074:0:17095:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9df45 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219080:0:17095:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784796.219094:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9df45 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219101:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c4183600/0x88ace7295d9df3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9df45 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219113:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784796.219119:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784796.219121:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784796.219139:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750187264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784796.219168:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784796.219197:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750187392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784796.219233:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784796.219288:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750187264 00000100:00100000:0.0:1787784796.219293:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750187264 00010000:00010000:0.0:1787784796.219309:0:17093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951df602a00/0x88ace7295d9e048 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e041 expref: 18 pid: 17102 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784796.219327:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750187392 00000100:00100000:0.0:1787784796.219330:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750187392 00010000:00010000:0.0:1787784796.219339:0:17093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8950c4183000/0x88ace7295d9df45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9df3e expref: 19 pid: 17101 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784796.219351:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784796.219358:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:3647:x1874627750187264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784796.219367:0:17093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784796.219371:0:17093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951df602a00/0x88ace7295d9e048 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e041 expref: 19 pid: 17102 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219380:0:17093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951df602a00/0x88ace7295d9e048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e041 expref: 19 pid: 17102 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219395:0:17093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784796.219421:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:3647:x1874627750187264:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784796.219427:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784796.219446:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784796.219452:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:3644:x1874627750187392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784796.219459:0:17093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784796.219463:0:17093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8950c4183000/0x88ace7295d9df45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9df3e expref: 18 pid: 17101 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219472:0:17093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8950c4183000/0x88ace7295d9df45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9df3e expref: 18 pid: 17101 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219483:0:17093:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219491:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219503:0:17093:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219510:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219517:0:17093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219523:0:17093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219529:0:17093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784796.219532:0:17093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219540:0:17093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219556:0:17093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.219565:0:17093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784796.219590:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:3644:x1874627750187392:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784796.219597:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784796.219630:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750187264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784796.219649:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750187392:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784796.219821:0:18259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df602a00/0x88ace7295d9e048 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e041 expref: 17 pid: 17102 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784796.219833:0:18259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32712c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18259:1874627750187008:0@lo:104: 00010000:00010000:2.0:1787784796.219841:0:18259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c4183000/0x88ace7295d9df45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9df3e expref: 16 pid: 17101 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784796.219861:0:18259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18259:1874627750187136:0@lo:104: 00010000:00010000:2.0:1787784796.219875:0:18259:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784796.219884:0:18259:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784796.219890:0:18259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784796.219896:0:18259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e09c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784796.220630:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784796.229945:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787784796.745899:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784797.255998:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787784797.516698:0:17104:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787784797.516707:0:17104:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8950c4020000 from 13 10000000:01000000:2.0:1787784797.516712:0:17104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784797.516760:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784797.516797:0:17104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784797.516809:0:17104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784797.516836:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750187520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784797.517011:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784797.517061:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d233c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784797.517756:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750187520 00000100:00100000:3.0:1787784797.517765:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750187520 00000100:00100000:3.0:1787784797.517835:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787784797.517854:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+16:17104:x1874627750187520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784797.517868:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784797.517882:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3712c00/0x88ace7295d9e0aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e0a3 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784797.517904:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3712c00/0x88ace7295d9e0aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e0a3 expref: 17 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784797.517914:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3712c00/0x88ace7295d9e0aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e0a3 expref: 17 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784797.517923:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712c00, rc 0) 00000100:00100000:3.0:1787784797.517976:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17104:x1874627750187520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784797.517982:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787784797.518170:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750187520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784797.518185:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e0aa expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784797.518195:0:17104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e0aa expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784797.518282:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750187648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784797.518315:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784797.518349:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784797.519036:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750187648 00000100:00100000:2.0:1787784797.519056:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750187648 00000100:00100000:2.0:1787784797.519098:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787784797.519106:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17104:x1874627750187648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784797.519262:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17104:x1874627750187648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784797.519270:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787784797.519310:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750187648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784797.519343:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750187776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784797.519382:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784797.519397:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784797.519409:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750187776 00000100:00100000:2.0:1787784797.519413:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750187776 00000100:00100000:2.0:1787784797.519428:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787784797.519434:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17104:x1874627750187776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784797.519501:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17104:x1874627750187776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784797.519507:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787784797.519542:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750187776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787784797.522414:0:18296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787784797.522789:0:17104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787784797.522819:0:17104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784797.522830:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e0aa expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784797.522842:0:17104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e0aa expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784797.522853:0:17104:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784797.522856:0:17104:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951fb22c000 from 13 10000000:01000000:3.0:1787784797.522859:0:17104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784797.522898:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784797.522905:0:17104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784797.522931:0:17104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784797.522958:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750187904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784797.523028:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784797.523068:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0bf9780 going to sleep for 11 seconds 00000100:00100000:2.0:1787784797.527266:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750187904 00000100:00100000:2.0:1787784797.527281:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750187904 00000100:00100000:2.0:1787784797.527351:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787784797.527361:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+17:17104:x1874627750187904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784797.527380:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784797.527397:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c4183600/0x88ace7295d9e0b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e0b1 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784797.527444:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c4183600/0x88ace7295d9e0b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e0b1 expref: 18 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784797.527456:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c4183600/0x88ace7295d9e0b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e0b1 expref: 18 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784797.527465:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183600, rc 0) 00000100:00100000:2.0:1787784797.527556:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17104:x1874627750187904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (4528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784797.527563:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787784797.527805:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750187904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784797.527823:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e0b8 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784797.527831:0:17104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e0b8 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784797.527903:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750188032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784797.527938:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784797.527972:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0bf9780 going to sleep for 11 seconds 00000100:00100000:0.0:1787784797.528106:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750188032 00000100:00100000:0.0:1787784797.528112:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750188032 00000100:00100000:0.0:1787784797.528159:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787784797.528168:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d2477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17104:x1874627750188032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784797.528304:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d2477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17104:x1874627750188032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784797.528311:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787784797.530022:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750188032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784797.530103:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750188160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784797.530182:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784797.530226:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0bf9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787784797.530838:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750188160 00000100:00100000:1.0:1787784797.530849:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750188160 00000100:00100000:1.0:1787784797.530914:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787784797.530925:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d2477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17104:x1874627750188160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784797.531074:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d2477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:17104:x1874627750188160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784797.531081:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787784797.532056:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5292d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750188160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787784797.537294:0:18297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787784797.537478:0:17104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787784797.537506:0:17104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784797.537517:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e0b8 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784797.537528:0:17104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e0b8 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784798.283503:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784798.343269:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784788/real 1787784788] req@ffff8951ff47e1c0 x1874627750181888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784798 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784798.343305:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951ff47e1c0 x1874627750181888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784798 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784798.343315:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784788/real 1787784788] req@ffff8951ff47c780 x1874627750181760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784798 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784798.343326:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951ff47c780 x1874627750181760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784798 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787784798.343344:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784798.346310:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787784798.346321:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750181888:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787784798.346333:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c2cc4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784798.349417:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784798.349423:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784798.349426:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784798.349429:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784798.349446:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784798.349450:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787784798.349453:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951c2cc4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784798.349462:0:15021:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 528 00000100:00080000:0.0:1787784798.349469:0:15021:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787784798.349475:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8951c2cc4800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784798.349495:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47cf00 x1874627750188800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784798.349508:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784798.349511:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787784798.349512:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784798.349515:0:15021:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 528 00000100:00080000:0.0:1787784798.349518:0:15021:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787784798.349521:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8951cfe44000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784798.349530:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47c3c0 x1874627750188928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784798.349585:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750188672:0@lo:400:kworker.0 00000100:00100000:0.0:1787784798.349651:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784798.349686:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787784798.349692:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750188288:0@lo:400:kworker.0 00000100:00100000:0.0:1787784798.349719:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784798.349749:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750189056:0@lo:400:kworker.0 00000100:00100000:0.0:1787784798.349806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784798.349833:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750188416:0@lo:400:kworker.0 00000100:00100000:0.0:1787784798.349856:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784798.349872:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784798.349877:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750188544:0@lo:400:kworker.0 00000100:00100000:0.0:1787784798.350997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784798.351061:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750188672 00000100:00100000:0.0:1787784798.351069:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750188672 00000100:00100000:0.0:1787784798.351110:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750188416 00000100:00100000:0.0:1787784798.352409:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750188416 00000100:00100000:0.0:1787784798.352455:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784798.352465:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750188672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784798.352555:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750188672:12345-0@lo:400:kworker.0 Request processed in 92us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784798.352563:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784798.352579:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784798.352586:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750188416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784798.352620:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750188416:12345-0@lo:400:kworker.0 Request processed in 34us (2763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784798.352643:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784798.352670:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750188288 00000100:00100000:0.0:1787784798.352674:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750188288 00000100:00100000:0.0:1787784798.352698:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787784798.352704:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d2475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:3644:x1874627750188288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784798.352735:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d2475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:3644:x1874627750188288:12345-0@lo:400:kworker.0 Request processed in 31us (3015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784798.352741:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787784798.352808:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750188416:0@lo:400:kworker.0 00000100:00100000:0.0:1787784798.352840:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750188288:0@lo:400:kworker.0 00000100:00100000:0.0:1787784798.352851:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750188672:0@lo:400:kworker.0 00000100:00100000:2.0:1787784798.354256:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750189056 00000100:00100000:2.0:1787784798.354266:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750189056 00000100:00100000:2.0:1787784798.354306:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750188544 00000100:00100000:2.0:1787784798.354309:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750188544 00000100:00100000:2.0:1787784798.354339:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784798.354348:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750189056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784798.354416:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750189056:12345-0@lo:400:kworker.0 Request processed in 70us (4609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784798.354435:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784798.354451:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784798.354456:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750188544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784798.354492:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750188544:12345-0@lo:400:kworker.0 Request processed in 35us (4595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784798.354498:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787784798.354536:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951ff47f0c0 x1874627750188544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784798.354550:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750188544:0@lo:400:kworker.0 00010000:00080000:2.0:1787784798.354583:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951ff47f480 x1874627750189056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784798.354593:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750189056:0@lo:400:kworker.0 00000100:00080000:1.0:1787784798.355455:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787784798.355473:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750181760:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787784798.355579:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750188800:0@lo:8:kworker.0 00000400:00000100:1.0:1787784798.355627:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750188800 offset 0 length 520: 4 00000100:00100000:1.0:1787784798.355662:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750188928:0@lo:8:kworker.0 00000400:00000100:1.0:1787784798.355679:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750188928 offset 0 length 520: 4 00000100:00080000:0.0:1787784798.357294:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784798.357305:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784798.357309:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784798.357312:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787784798.863300:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784798.863385:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750189184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784798.863457:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784798.863506:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750189184 00000100:00100000:0.0:1787784798.863513:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750189184 00000100:00100000:0.0:1787784798.863557:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787784798.863565:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750189184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784798.863597:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787784798.863653:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750189184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784798.863661:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787784798.863705:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750189184:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787784799.302540:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784799.366017:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784784/real 1787784784] req@ffff8950c34130c0 x1874627750179840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784799 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784799.366047:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8950c34130c0 x1874627750179840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784799 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784799.366057:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784784/real 1787784784] req@ffff8950c34121c0 x1874627750179968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784799 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784799.366069:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8950c34121c0 x1874627750179968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784799 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787784799.366089:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c642d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784799.366098:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787784799.366110:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750179840:0@lo:8:kworker.0 00000100:00080000:1.0:1787784799.366116:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784799.366121:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787784799.366124:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750179968:0@lo:8:kworker.0 00000100:00080000:0.0:1787784799.367165:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784799.367169:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787784799.367171:0:37:0:(import.c:65:import_set_state_nolock()) ffff8951c642d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784799.367177:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:0.0:1787784799.367183:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787784799.367190:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8951c642d800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784799.367210:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951d9e130c0 x1874627750189568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784799.367223:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784799.367226:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787784799.367228:0:37:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784799.367240:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:0.0:1787784799.367243:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787784799.367246:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8951c3238800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784799.367258:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951d9e112c0 x1874627750189696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784799.367273:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784799.367275:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784799.367277:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784799.367279:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787784799.367317:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750189312:0@lo:400:kworker.0 00000100:00100000:0.0:1787784799.367386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784799.367425:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784799.367432:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750189952:0@lo:400:kworker.0 00000100:00100000:0.0:1787784799.367455:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784799.367478:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750189440:0@lo:400:kworker.0 00000100:00100000:0.0:1787784799.367498:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784799.367510:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784799.367514:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750189824:0@lo:400:kworker.0 00000100:00100000:0.0:1787784799.367528:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784799.367552:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750189952 00000100:00100000:0.0:1787784799.367558:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750189952 00000100:00100000:0.0:1787784799.367590:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750189824 00000100:00100000:0.0:1787784799.367592:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750189824 00000100:00100000:0.0:1787784799.367605:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784799.367612:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750189952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784799.367652:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750189952:12345-0@lo:400:kworker.0 Request processed in 41us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784799.367659:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784799.367672:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784799.367677:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750189824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784799.367697:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750189824:12345-0@lo:400:kworker.0 Request processed in 20us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784799.367702:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787784799.367725:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951d9e103c0 x1874627750189824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784799.367748:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750189824:0@lo:400:kworker.0 00010000:00080000:0.0:1787784799.367789:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951d9e11e00 x1874627750189952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784799.367797:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750189952:0@lo:400:kworker.0 00000100:00100000:1.0:1787784799.368062:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750189312 00000100:00100000:1.0:1787784799.368066:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750189312 00000100:00100000:1.0:1787784799.368096:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787784799.368107:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c2dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:3647:x1874627750189312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784799.368140:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c2dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:3647:x1874627750189312:12345-0@lo:400:kworker.0 Request processed in 39us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784799.368145:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787784799.368166:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750189440 00000100:00100000:1.0:1787784799.368169:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750189440 00000100:00100000:1.0:1787784799.368190:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784799.368196:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750189440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784799.368241:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750189440:12345-0@lo:400:kworker.0 Request processed in 36us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784799.368247:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784799.368272:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750189568:0@lo:8:kworker.0 00000400:00000100:1.0:1787784799.368288:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750189568 offset 0 length 520: 4 00000100:00100000:1.0:1787784799.368302:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750189696:0@lo:8:kworker.0 00000400:00000100:1.0:1787784799.368314:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750189696 offset 0 length 520: 4 00000100:00100000:1.0:1787784799.368342:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750189440:0@lo:400:kworker.0 00000100:00100000:0.0:1787784799.368491:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750190080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784799.368514:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784799.368545:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750189312:0@lo:400:kworker.0 00000100:00100000:1.0:1787784799.368599:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750190080 00000100:00100000:1.0:1787784799.368602:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750190080 00000100:00100000:1.0:1787784799.368627:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787784799.368633:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750190080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784799.368654:0:17112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787784799.368695:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750190080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784799.368701:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784799.368758:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750190080:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1787784799.886474:0:17840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1787784800.074036:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787784800.328414:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784801.354349:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784802.375266:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784803.400002:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787784803.806486:0:18608:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787784803.806490:0:18608:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787784803.806491:0:18608:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787784803.806615:0:18608:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8951f6b92000 00000020:01000004:0.0:1787784803.806631:0:18608:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787784803.807942:0:18608:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787784803.807981:0:18608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8951fd7b99b8) 00000020:00000080:0.0:1787784803.808006:0:18608:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787784803.863240:0:18608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787784803.869126:0:18608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787784803.870802:0:18608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787784803.871330:0:18608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787784803.871552:0:18608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787784803.871910:0:18608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787784803.872142:0:18608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1787784803.875374:0:18608:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787784803.875600:0:18608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787784803.875614:0:18608:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787784803.875627:0:18608:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x88ace7295d9e0c6 00000020:01000004:2.0:1787784803.875635:0:18608:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787784803.875688:0:18608:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787784803.875692:0:18608:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787784803.875699:0:18608:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787784803.875704:0:18608:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787784803.875715:0:18608:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8951f02db370) 00000020:00000080:2.0:1787784803.875728:0:18608:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787784803.879659:0:18608:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784803.880381:0:18608:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787784803.880388:0:18608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787784803.882618:0:18608:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787784803.882629:0:18608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787784803.885040:0:18608:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787784803.885054:0:18608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787784803.889514:0:18608:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784803.889705:0:18608:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787784803.889712:0:18608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787784803.901332:0:18608:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787784803.901345:0:18608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787784803.934303:0:18608:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784803.934541:0:18608:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787784803.934548:0:18608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787784803.937599:0:18608:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787784803.937611:0:18608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787784803.938583:0:18608:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787784803.938592:0:18608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787784803.940524:0:18608:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784803.940900:0:18608:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787784803.940907:0:18608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787784803.944478:0:18608:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787784803.944493:0:18608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787784803.973978:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750190208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784803.974090:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784803.974219:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750190208 00000100:00100000:0.0:1787784803.974233:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750190208 00000100:00100000:0.0:1787784803.974296:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787784803.974305:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750190208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784803.974338:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787784803.974403:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750190208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784803.974410:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787784803.974456:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750190208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784804.015421:0:18608:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784804.015641:0:18608:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787784804.015648:0:18608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787784804.024279:0:18608:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787784804.024297:0:18608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787784804.024996:0:18608:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787784804.025026:0:18608:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787784804.025033:0:18608:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787784804.049148:0:18608:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787784804.049208:0:18608:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787784804.049214:0:18608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787784804.049215:0:18608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787784804.049217:0:18608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784804.049218:0:18608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784804.049219:0:18608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784804.049221:0:18608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784804.049222:0:18608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787784804.049224:0:18608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784804.049225:0:18608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787784804.049229:0:18608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787784804.049231:0:18608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787784804.049233:0:18608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787784804.049234:0:18608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784804.049235:0:18608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784804.049236:0:18608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784804.049238:0:18608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784804.049239:0:18608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787784804.049240:0:18608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784804.049241:0:18608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787784804.049278:0:18608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787784804.049299:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5292940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750190336:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787784804.049372:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784804.049426:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784804.049559:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750190336 00000100:00100000:2.0:1787784804.049567:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750190336 00000100:00100000:2.0:1787784804.049641:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787784804.049651:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:18608:x1874627750190336:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787784804.049679:0:17100:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787784804.049683:0:17100:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787784804.049687:0:17100:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787784804.052534:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:18608:x1874627750190336:12345-0@lo:253:mount.lustre.0 Request processed in 2875us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784804.052548:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787784804.059812:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5292940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750190336:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787784804.059831:0:18608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787784804.059835:0:18608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787784804.059836:0:18608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787784804.059838:0:18608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784804.059839:0:18608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784804.059840:0:18608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784804.059842:0:18608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784804.059843:0:18608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784804.059845:0:18608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784804.059846:0:18608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787784804.059893:0:18608:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8951f6b92000 from lustre-OST0000 10000000:01000000:0.0:1787784804.059948:0:18608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787784804.059951:0:18608:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787784804.059961:0:18608:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8951cfef4d28 local copy 00010000:00010000:0.0:1787784804.059972:0:18608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784804.060728:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750190464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784804.060828:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.060881:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24daa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784804.061429:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750190464 00000100:00100000:2.0:1787784804.061436:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750190464 00000100:00100000:2.0:1787784804.061492:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787784804.061501:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:18608:x1874627750190464:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784804.061618:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:18608:x1874627750190464:12345-0@lo:501:mount.lustre.0 Request processed in 117us (789us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787784804.061626:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787784804.062032:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750190464:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787784804.062051:0:18608:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787784804.062291:0:18608:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787784804.062300:0:18608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784804.062310:0:18608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784804.062338:0:18608:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8951f6b92000 10000000:01000000:0.0:1787784804.062342:0:18608:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787784804.062347:0:18608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787784804.062350:0:18608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787784804.062354:0:18608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787784804.062356:0:18608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787784804.062381:0:18608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784804.062388:0:18608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784804.062397:0:18608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784804.062422:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750190592:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787784804.062454:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.062488:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24daa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784804.063883:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750190592 00000100:00100000:3.0:1787784804.063897:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750190592 00000100:00100000:3.0:1787784804.063960:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787784804.063970:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ce8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+18:18608:x1874627750190592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784804.063986:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784804.064003:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3713a00/0x88ace7295d9e0db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e0d4 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784804.064041:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3713a00/0x88ace7295d9e0db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e0d4 expref: 19 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784804.064051:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3713a00/0x88ace7295d9e0db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e0d4 expref: 19 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784804.064060:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713a00, rc 0) 00000100:00100000:3.0:1787784804.064261:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ce8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:18608:x1874627750190592:12345-0@lo:101:mount.lustre.0 Request processed in 292us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784804.064269:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787784804.064404:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750190592:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784804.064421:0:18608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784804.064429:0:18608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784804.069808:0:18608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787784804.070615:0:18608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784804.077822:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787784804.077876:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787784804.077889:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787784804.077901:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787784804.077911:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787784804.077921:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787784804.077940:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787784804.077944:0:18608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787784804.078041:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750190720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784804.078112:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784804.078144:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784804.078387:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750190720 00000100:00100000:1.0:1787784804.078394:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750190720 00000100:00100000:1.0:1787784804.078449:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787784804.078459:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:18608:x1874627750190720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784804.078609:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:18608:x1874627750190720:12345-0@lo:501:mount.lustre.0 Request processed in 151us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784804.078617:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787784804.079976:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750190720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784804.080034:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750190848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784804.080978:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784804.081029:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784804.081180:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750190848 00000100:00100000:2.0:1787784804.081208:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750190848 00000100:00100000:2.0:1787784804.081264:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787784804.081275:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:18608:x1874627750190848:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784804.083577:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:18608:x1874627750190848:12345-0@lo:503:mount.lustre.0 Request processed in 2296us (2594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784804.083592:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787784804.083849:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750190848:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787784804.085320:0:18608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784804.085413:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750190976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784804.085488:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784804.085593:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784804.089271:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750190976 00000100:00100000:1.0:1787784804.089288:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750190976 00000100:00100000:1.0:1787784804.089403:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787784804.089415:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8952021e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:18608:x1874627750190976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784804.091827:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8952021e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:18608:x1874627750190976:12345-0@lo:502:mount.lustre.0 Request processed in 2405us (6330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784804.091841:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787784804.091842:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750190976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787784804.092128:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787784804.092163:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787784804.092181:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787784804.092207:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787784804.092221:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787784804.092234:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787784804.092248:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787784804.092260:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787784804.092272:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787784804.092285:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787784804.092299:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787784804.092312:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787784804.092350:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784804.092398:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.092450:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24daf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784804.092515:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750191104 00000100:00100000:2.0:1787784804.092523:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750191104 00000100:00100000:2.0:1787784804.092557:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787784804.092565:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8952021e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:18608:x1874627750191104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784804.092692:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8952021e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:18608:x1874627750191104:12345-0@lo:502:mount.lustre.0 Request processed in 127us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784804.092700:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787784804.093100:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787784804.093146:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787784804.093156:0:18608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787784804.094511:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787784804.094522:0:18625:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787784804.094529:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.094531:0:18625:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787784804.094550:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784804.094576:0:18625:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff895201d0cd28) 00000020:00000080:1.0:1787784804.094603:0:18625:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787784804.094609:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787784804.094699:0:18625:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951f6b92000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787784804.094707:0:18625:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787784804.094714:0:18625:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x88ace7295d9e0e9 00010000:00010000:1.0:1787784804.108030:0:18625:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1787784804.109912:0:18625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:1.0:1787784804.113871:0:18625:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787784804.119614:0:18625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787784804.119630:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784804.119636:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.119651:0:18625:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787784804.119656:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787784804.119658:0:18625:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1787784804.119660:0:18625:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787784804.119661:0:18625:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787784804.119662:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787784804.119665:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.119667:0:18625:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787784804.119669:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784804.119672:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.119673:0:18625:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787784804.119676:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787784804.119678:0:18625:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787784804.119680:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784804.119682:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.119683:0:18625:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787784804.119685:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784804.119688:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.119689:0:18625:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787784804.119693:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787784804.119725:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784804.119729:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.119737:0:18625:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787784804.119740:0:18625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787784804.120030:0:18608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787784804.120061:0:18608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787784804.120093:0:18608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784804.120104:0:18608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784804.120113:0:18608:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951f6b92000 from 1 10000000:01000000:0.0:1787784804.120117:0:18608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784804.120152:0:18608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784804.120160:0:18608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784804.120170:0:18608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784804.120206:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191232:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787784804.120275:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.120320:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784804.120371:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750191232 00000100:00100000:3.0:1787784804.120377:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750191232 00000100:00100000:3.0:1787784804.120428:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787784804.120438:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:18608:x1874627750191232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784804.120452:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784804.120463:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3712400/0x88ace7295d9e0f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e0f0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784804.120488:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3712400/0x88ace7295d9e0f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e0f0 expref: 20 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784804.120499:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3712400/0x88ace7295d9e0f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e0f0 expref: 20 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784804.120507:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712400, rc 0) 00000100:00100000:3.0:1787784804.120547:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:18608:x1874627750191232:12345-0@lo:101:mount.lustre.0 Request processed in 111us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784804.120554:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787784804.124944:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191232:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784804.124974:0:18608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e0f7 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784804.125001:0:18608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e0f7 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787784804.128988:0:18608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787784804.129303:0:18608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784804.129476:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787784804.129502:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787784804.129518:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787784804.129523:0:18608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787784804.129598:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784804.129678:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784804.129720:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f02169c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784804.130010:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750191360 00000100:00100000:2.0:1787784804.130018:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750191360 00000100:00100000:2.0:1787784804.130071:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787784804.130081:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:18608:x1874627750191360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784804.130204:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:18608:x1874627750191360:12345-0@lo:501:mount.lustre.0 Request processed in 124us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784804.130212:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787784804.130294:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784804.130333:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191488:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784804.130378:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.130409:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24daa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784804.135804:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750191488 00000100:00100000:1.0:1787784804.135819:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750191488 00000100:00100000:1.0:1787784804.135889:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787784804.135900:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:18608:x1874627750191488:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784804.136084:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:18608:x1874627750191488:12345-0@lo:503:mount.lustre.0 Request processed in 185us (5704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784804.136092:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787784804.140697:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191488:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787784804.141207:0:18608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787784804.141303:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784804.141392:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.141438:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784804.143323:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750191616 00000100:00100000:3.0:1787784804.143336:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750191616 00000100:00100000:3.0:1787784804.143407:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787784804.143418:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:18608:x1874627750191616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784804.143590:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:18608:x1874627750191616:12345-0@lo:502:mount.lustre.0 Request processed in 173us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784804.143607:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787784804.144201:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787784804.144452:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787784804.144481:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787784804.144493:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787784804.144505:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787784804.144516:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787784804.144528:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787784804.144540:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787784804.144552:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1787784804.144581:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787784804.144594:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1787784804.144606:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1787784804.144641:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784804.144702:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.144739:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24daf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784804.144800:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750191744 00000100:00100000:1.0:1787784804.144805:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750191744 00000100:00100000:1.0:1787784804.144853:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787784804.144863:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:18608:x1874627750191744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784804.144962:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:18608:x1874627750191744:12345-0@lo:502:mount.lustre.0 Request processed in 100us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784804.144969:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787784804.145187:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784804.145245:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787784804.145254:0:18608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787784804.146899:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784804.146912:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.146914:0:18629:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787784804.146921:0:18629:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951f6b92000 00000020:00000080:1.0:1787784804.146930:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787784804.146939:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784804.146942:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.146943:0:18629:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787784804.146946:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784804.146948:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.146950:0:18629:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787784804.146953:0:18629:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951f6b92000 00000020:00000080:1.0:1787784804.146955:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787784804.147003:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784804.147007:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.147008:0:18629:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787784804.147010:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784804.147013:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.147014:0:18629:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787784804.147017:0:18629:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951f6b92000 00000020:00000080:1.0:1787784804.147019:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787784804.147033:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784804.147036:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.147037:0:18629:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787784804.147039:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784804.147041:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.147042:0:18629:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787784804.147046:0:18629:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951f6b92000 00000020:00000080:1.0:1787784804.147047:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787784804.147077:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784804.147081:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784804.147082:0:18629:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787784804.147085:0:18629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1787784804.147354:0:18608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787784804.147382:0:18608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784804.147404:0:18608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e0f7 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784804.147415:0:18608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e0f7 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784804.147462:0:18608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787784804.147465:0:18608:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8951f6b92000 10000000:01000000:3.0:1787784804.147468:0:18608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8951f6b92000 10000000:01000000:3.0:1787784804.147472:0:18608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784804.147478:0:18608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951f6b92000 from 1 10000000:01000000:3.0:1787784804.147480:0:18608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787784804.147512:0:18608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784804.147521:0:18608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784804.147531:0:18608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784804.147551:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784804.147619:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784804.147667:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784804.152242:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750191872 00000100:00100000:0.0:1787784804.152258:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750191872 00000100:00100000:0.0:1787784804.152327:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787784804.152337:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:18608:x1874627750191872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784804.152356:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784804.152375:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e105 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e0fe expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784804.152402:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e0fe expref: 21 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784804.152413:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e0fe expref: 21 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784804.152422:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629e00, rc 0) 00000100:00100000:0.0:1787784804.152503:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:18608:x1874627750191872:12345-0@lo:101:mount.lustre.0 Request processed in 167us (4884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784804.152510:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787784804.154706:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750191872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784804.154735:0:18608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784804.154748:0:18608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784804.164496:0:18608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787784804.164861:0:18608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787784804.165090:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787784804.165117:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787784804.165151:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787784804.165166:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787784804.165178:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787784804.165201:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787784804.165216:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787784804.165228:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787784804.165503:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787784804.165524:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787784804.165538:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787784804.165551:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787784804.165564:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787784804.165577:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787784804.165591:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787784804.165604:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787784804.165617:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787784804.165629:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787784804.165659:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787784804.165675:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787784804.165689:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787784804.165700:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787784804.165713:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787784804.165727:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787784804.165740:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787784804.165753:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787784804.165790:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787784804.165808:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787784804.165821:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787784804.165835:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787784804.165848:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787784804.165861:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787784804.165874:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787784804.165888:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787784804.165916:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787784804.165931:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787784804.165944:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787784804.165965:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787784804.165970:0:18608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787784804.166082:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750192000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784804.166159:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.166210:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750192000 00000100:00100000:0.0:1787784804.166218:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750192000 00000100:00100000:0.0:1787784804.166481:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787784804.166490:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:18608:x1874627750192000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784804.166598:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:18608:x1874627750192000:12345-0@lo:501:mount.lustre.0 Request processed in 109us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784804.166606:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787784804.166649:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24da600 going to sleep for 11 seconds 00000100:00100000:0.0:1787784804.166671:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750192000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784804.166701:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750192128:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784804.166735:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.174574:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24da600 going to sleep for 11 seconds 00000100:00100000:0.0:1787784804.175104:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750192128 00000100:00100000:0.0:1787784804.175114:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750192128 00000100:00100000:0.0:1787784804.175164:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787784804.175172:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:18608:x1874627750192128:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784804.175347:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:18608:x1874627750192128:12345-0@lo:503:mount.lustre.0 Request processed in 175us (8610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784804.175355:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787784804.175422:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750192128:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787784804.175892:0:18608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787784804.175966:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750192256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784804.176010:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.176037:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750192256 00000100:00100000:0.0:1787784804.176047:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750192256 00000100:00100000:0.0:1787784804.176074:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787784804.176081:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:18608:x1874627750192256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784804.176166:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:18608:x1874627750192256:12345-0@lo:502:mount.lustre.0 Request processed in 85us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784804.176173:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787784804.176219:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33b53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784804.176233:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750192256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787784804.176387:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787784804.176412:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787784804.176426:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787784804.176438:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787784804.176451:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787784804.176463:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787784804.176476:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787784804.176488:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787784804.176500:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787784804.176523:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787784804.176537:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787784804.176550:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787784804.176562:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787784804.176573:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787784804.176583:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787784804.176594:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787784804.176606:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787784804.176618:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787784804.176630:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787784804.176641:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787784804.176654:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787784804.176666:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787784804.176692:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787784804.176705:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787784804.176718:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787784804.176745:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787784804.176799:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787784804.176813:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787784804.176823:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787784804.176834:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787784804.176844:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787784804.176856:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787784804.176868:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787784804.176882:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787784804.176894:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787784804.176908:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787784804.176920:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787784804.176931:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787784804.176942:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787784804.176955:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787784804.176966:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787784804.176992:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787784804.177007:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787784804.177020:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787784804.177033:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787784804.177046:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787784804.177058:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787784804.177072:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787784804.177105:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750192384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784804.177150:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.177182:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24da600 going to sleep for 11 seconds 00000100:00100000:3.0:1787784804.177241:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750192384 00000100:00100000:3.0:1787784804.177247:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750192384 00000100:00100000:3.0:1787784804.177287:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787784804.177296:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:18608:x1874627750192384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784804.177383:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:18608:x1874627750192384:12345-0@lo:502:mount.lustre.0 Request processed in 88us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784804.177390:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787784804.181002:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750192384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787784804.181606:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787784804.181645:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787784804.181684:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750192512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784804.181760:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.181838:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784804.183036:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750192512 00000100:00100000:2.0:1787784804.183046:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750192512 00000100:00100000:2.0:1787784804.183216:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787784804.183226:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:18608:x1874627750192512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784804.183374:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:18608:x1874627750192512:12345-0@lo:502:mount.lustre.0 Request processed in 149us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784804.183389:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787784804.187505:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750192512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787784804.187633:0:18608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787784804.187648:0:18608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787784804.197763:0:18634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787784804.197796:0:18634:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8951ebd50000) 00000020:00000080:1.0:1787784804.197823:0:18634:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1787784804.197922:0:18634:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951f6b92000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787784804.197931:0:18634:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951f6b92000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787784804.197934:0:18634:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951f6b92000 3 00010000:00080000:1.0:1787784804.197964:0:18634:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951cfe41000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1787784804.199563:0:18634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1787784804.199765:0:18634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787784804.199818:0:18634:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787784804.199829:0:18634:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x88ace7295d9e113 00000100:00080000:1.0:1787784804.199839:0:18634:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784804.199845:0:18634:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8951cfe41000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784804.199881:0:18634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951cffc8b40 x1874627750192640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784804.199926:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874627750192640:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784804.199990:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.200025:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750192640 00000100:00100000:0.0:1787784804.200032:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750192640 00000100:00080000:1.0:1787784804.200044:0:18634:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787784804.200063:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784804.200070:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874627750192640:12345-0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787784804.200090:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00010000:00080000:0.0:1787784804.200091:0:17108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000100:00080000:1.0:1787784804.200093:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784804.200096:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784804.200098:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784804.200115:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784804.200118:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:0.0:1787784804.200120:0:17108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x88ace7295d9e11a 00000100:00080000:1.0:1787784804.200121:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784804.200123:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00100000:0.0:1787784804.200133:0:17108:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787784804.200161:0:17108:0:(import.c:65:import_set_state_nolock()) ffff8951c7767000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784804.200591:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750192768:0@lo:400:kworker.0 00000100:00100000:3.0:1787784804.200626:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784804.200688:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750193024:0@lo:400:kworker.0 00000100:00100000:3.0:1787784804.200714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784804.200732:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784804.200736:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750192896:0@lo:400:kworker.0 00000100:00100000:3.0:1787784804.200757:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784804.200797:0:17107:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784804.200804:0:17107:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787784804.204026:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874627750192640:12345-0@lo:38:llog_process_th.0 Request processed in 3945us (4026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784804.204041:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784804.204073:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750193024 00000100:00100000:0.0:1787784804.204080:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750193024 00000100:00100000:0.0:1787784804.204110:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750192896 00000100:00100000:0.0:1787784804.204113:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750192896 00000100:00100000:0.0:1787784804.204127:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784804.204132:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750192768 00000100:00100000:0.0:1787784804.204134:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750193024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784804.204136:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750192768 00000100:00100000:1.0:1787784804.204168:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787784804.204175:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750192768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784804.204205:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750193024:12345-0@lo:400:kworker.0 Request processed in 71us (3490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784804.204212:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784804.204225:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750192768:12345-0@lo:400:kworker.0 Request processed in 51us (3599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784804.204230:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787784804.204245:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784804.204252:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5292580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750192896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784804.204501:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5292580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750192896:12345-0@lo:400:kworker.0 Request processed in 250us (3742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784804.204507:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787784804.205963:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951cffc8b40 x1874627750192640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784804.205978:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784804.205989:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787784804.205998:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787784804.206003:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787784804.206007:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe41000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787784804.206014:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874627750192640:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787784804.207044:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750192768:0@lo:400:kworker.0 00010000:00080000:2.0:1787784804.207098:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951cffc9a40 x1874627750192896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784804.207108:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750192896:0@lo:400:kworker.0 00010000:00080000:2.0:1787784804.207119:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951cffc8000 x1874627750193024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784804.207126:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750193024:0@lo:400:kworker.0 00000020:01000004:1.0:1787784804.209344:0:18634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787784804.209362:0:18634:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8951ebd54d28) 00000020:00000080:1.0:1787784804.209392:0:18634:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1787784804.209486:0:18634:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951f6b92000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787784804.209489:0:18634:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951f6b92000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787784804.209492:0:18634:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951f6b92000 3 00010000:00080000:1.0:1787784804.209528:0:18634:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c2641800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1787784804.217342:0:18634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1787784804.217537:0:18634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787784804.217582:0:18634:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787784804.217595:0:18634:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x88ace7295d9e128 00000100:00080000:1.0:1787784804.217606:0:18634:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784804.217613:0:18634:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8950c2641800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784804.221201:0:18634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951cffc83c0 x1874627750193152/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784804.221249:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874627750193152:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784804.221344:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784804.221413:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750193152 00000100:00100000:1.0:1787784804.221420:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750193152 00000100:00100000:1.0:1787784804.221459:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784804.221466:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874627750193152:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787784804.221505:0:17108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:1.0:1787784804.221562:0:17108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x88ace7295d9e12f 00000004:00100000:1.0:1787784804.221581:0:17108:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787784804.221617:0:17108:0:(import.c:65:import_set_state_nolock()) ffff8950c2645800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784804.221667:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874627750193152:12345-0@lo:38:llog_process_th.0 Request processed in 200us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784804.221674:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787784804.221714:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951cffc83c0 x1874627750193152/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784804.221723:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784804.221732:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787784804.221740:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787784804.221744:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787784804.221747:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c2641800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787784804.221752:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874627750193152:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787784804.221789:0:18634:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787784804.221813:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784804.221817:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784804.221820:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784804.221822:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784804.221826:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784804.221829:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784804.221831:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784804.221834:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1787784804.224219:0:18634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1787784804.225868:0:18608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787784804.225921:0:18608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787784804.225950:0:18608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784804.225963:0:18608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787784804.226040:0:18608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787784804.226042:0:18608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787784804.226043:0:18608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784804.226045:0:18608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784804.226046:0:18608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784804.226048:0:18608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784804.226049:0:18608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784804.226051:0:18608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784804.226052:0:18608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784804.226057:0:18608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787784804.226059:0:18608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784804.226072:0:18608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787784804.226073:0:18608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784804.226075:0:18608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784804.226076:0:18608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784804.226077:0:18608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784804.226078:0:18608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784804.226079:0:18608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784804.226080:0:18608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784804.226109:0:18608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787784804.226129:0:18608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32712c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750193280:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787784804.226213:0:18608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784804.226257:0:18608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951ebbec6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784804.226432:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750193280 00000100:00100000:3.0:1787784804.226441:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750193280 00000100:00100000:3.0:1787784804.226508:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787784804.226518:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:18608:x1874627750193280:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787784804.226560:0:17101:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787784804.226574:0:17101:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787784804.244701:0:17101:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787784804.244724:0:17101:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787784804.245096:0:17123:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787784804.245101:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787784804.245121:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784804.245138:0:17123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8950c4183400/0x88ace7295d9e080 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e079 expref: 21 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784804.245146:0:17123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8950c4183200/0x88ace7295d9e08e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e087 expref: 21 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784804.245168:0:17123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784804.245218:0:17123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8950c4183200/0x88ace7295d9e08e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e087 expref: 21 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784804.245232:0:17123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8950c4183200/0x88ace7295d9e08e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e087 expref: 21 pid: 17101 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784804.245248:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750193408:0@lo:104: 00000100:00100000:2.0:1787784804.245313:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787784804.245364:0:17123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8950c4183400/0x88ace7295d9e080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e079 expref: 21 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784804.245372:0:17123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8950c4183400/0x88ace7295d9e080 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e079 expref: 21 pid: 17100 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784804.245381:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750193536:0@lo:104: 00000100:00100000:2.0:1787784804.245405:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784804.245427:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951ebbec240 going to sleep for 11 seconds 00000100:00100000:1.0:1787784804.245596:0:17090:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787784804.245618:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750193408 00000100:00100000:1.0:1787784804.245626:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750193408 00000100:00100000:1.0:1787784804.245659:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750193536 00000100:00100000:1.0:1787784804.245662:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750193536 00000100:00100000:1.0:1787784804.245691:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784804.245699:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3273c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+4:17123:x1874627750193408:12345-0@lo:104: 00010000:00010000:1.0:1787784804.245711:0:17090:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e08e expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.245797:0:17090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787784804.245803:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3273c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+4:17123:x1874627750193408:12345-0@lo:104: Request processed in 104us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784804.245811:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784804.245827:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784804.245833:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c411c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+3:17123:x1874627750193536:12345-0@lo:104: 00010000:00010000:1.0:1787784804.245840:0:17090:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e080 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.245885:0:17090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787784804.245890:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c411c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+3:17123:x1874627750193536:12345-0@lo:104: Request processed in 58us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784804.245896:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787784804.245928:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784804.245934:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e08e expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.245955:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182a00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:1.0:1787784804.245958:0:17095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e08e expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.245967:0:17095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e08e expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784804.245974:0:17095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e08e expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784804.245980:0:17095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784804.246007:0:17095:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e08e expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.246014:0:17095:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784804.246033:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e08e expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.246042:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e087 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e08e expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.246056:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784804.246229:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e080 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.246238:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629200 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:1.0:1787784804.246242:0:17095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e080 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.246259:0:17095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e080 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784804.246266:0:17095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e080 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784804.246272:0:17095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784804.246286:0:17095:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e080 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.246291:0:17095:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784804.246298:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e080 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.246305:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e079 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e080 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.246317:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784804.246319:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784804.246321:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784804.246336:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784804.246354:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750193664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784804.246384:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784804.246408:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784804.246414:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750193792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784804.246435:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784804.246465:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750193664 00000100:00100000:1.0:1787784804.246469:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750193664 00010000:00010000:1.0:1787784804.246486:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8950c4183200/0x88ace7295d9e08e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e087 expref: 22 pid: 17101 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784804.246511:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750193792 00000100:00100000:1.0:1787784804.246514:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750193792 00010000:00010000:1.0:1787784804.246524:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8950c4183400/0x88ace7295d9e080 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e079 expref: 23 pid: 17100 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784804.246536:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784804.246542:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:3644:x1874627750193664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784804.246552:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784804.246557:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8950c4183200/0x88ace7295d9e08e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e087 expref: 23 pid: 17101 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.246567:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8950c4183200/0x88ace7295d9e08e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e087 expref: 23 pid: 17101 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.246583:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784804.246610:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:3644:x1874627750193664:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784804.246617:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784804.246628:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784804.246634:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c403a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:3644:x1874627750193792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784804.246641:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784804.246645:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8950c4183400/0x88ace7295d9e080 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e079 expref: 22 pid: 17100 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.246655:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8950c4183400/0x88ace7295d9e080 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e079 expref: 22 pid: 17100 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784804.247041:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:18608:x1874627750193280:12345-0@lo:253:mount.lustre.0 Request processed in 20522us (20825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784804.247049:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787784804.247108:0:18608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32712c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:18608:1874627750193280:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787784804.247119:0:18608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787784804.247122:0:18608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784804.247124:0:18608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787784804.247125:0:18608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784804.247134:0:18608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784804.247136:0:18608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784804.247137:0:18608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784804.247139:0:18608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784804.247140:0:18608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784804.247142:0:18608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787784804.247155:0:18608:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787784804.248038:0:17094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.248116:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787784804.248134:0:17094:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003433733s 00010000:00010000:1.0:1787784804.248140:0:17094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.248147:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.248155:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.248162:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.248168:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784804.248172:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.248181:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.248204:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.248216:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784804.248259:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c403a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3644:x1874627750193792:12345-0@lo:103:ldlm_bl.0 Request processed in 1624us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784804.248268:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784804.248418:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750193792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784804.248428:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750193664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784804.248457:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c4183200/0x88ace7295d9e08e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e087 expref: 20 pid: 17101 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784804.248470:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750193408:0@lo:104: 00010000:00010000:1.0:1787784804.248480:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c4183400/0x88ace7295d9e080 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e079 expref: 19 pid: 17100 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784804.248489:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750193536:0@lo:104: 00010000:00010000:1.0:1787784804.248502:0:17123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.248510:0:17123:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.248516:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784804.248523:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c4182200/0x88ace7295d9e136 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1787784804.263834:0:18608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787784804.269904:0:18608:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787784804.269916:0:18608:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787784804.269953:0:18608:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787784804.270002:0:18608:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787784804.270034:0:18608:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787784804.270245:0:18608:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787784804.275055:0:18608:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787784804.275454:0:18608:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787784804.422503:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784804.493319:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750193920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784804.493396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784804.493515:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750193920 00000100:00100000:0.0:1787784804.493522:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750193920 00000100:00100000:0.0:1787784804.493569:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784804.493577:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750193920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784804.493608:0:17112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787784804.493659:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750193920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784804.493667:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787784804.493759:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750193920:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787784805.449437:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787784805.528129:0:18689:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787784805.529255:0:18689:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1787784806.085904:0:17104:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787784806.085914:0:17104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8950c4020000 from 9 10000000:01000000:1.0:1787784806.085919:0:17104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787784806.085971:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784806.085984:0:17104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784806.085996:0:17104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784806.086022:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750194048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784806.086107:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784806.086160:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa99b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784806.086932:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750194048 00000100:00100000:0.0:1787784806.086940:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750194048 00000100:00100000:0.0:1787784806.087002:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787784806.087012:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:17104:x1874627750194048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784806.087028:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784806.087056:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e144 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e13d expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784806.087081:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e13d expref: 20 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784806.087091:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e13d expref: 20 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784806.087112:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628c00, rc 0) 00000100:00100000:0.0:1787784806.087167:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:17104:x1874627750194048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784806.087184:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787784806.087803:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750194048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784806.087822:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e144 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784806.087841:0:17104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e144 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784806.087907:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750194176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787784806.087952:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784806.087979:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784806.088159:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750194176 00000100:00100000:1.0:1787784806.088165:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750194176 00000100:00100000:1.0:1787784806.088267:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787784806.088277:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:17104:x1874627750194176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787784806.088295:0:17101:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787784806.088312:0:17101:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787784806.088316:0:17101:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787784806.088406:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:17104:x1874627750194176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784806.088414:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787784806.088447:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750194176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787784806.088504:0:17104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787784806.088517:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e144 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784806.088525:0:17104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e144 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784806.088537:0:17104:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787784806.088540:0:17104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951fb22c000 from 9 10000000:01000000:1.0:1787784806.088543:0:17104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787784806.088564:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784806.088572:0:17104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784806.088580:0:17104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784806.088593:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750194304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784806.088635:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784806.088651:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa99be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784806.088664:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750194304 00000100:00100000:1.0:1787784806.088667:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750194304 00000100:00100000:1.0:1787784806.088690:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787784806.088696:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:17104:x1874627750194304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784806.088704:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784806.088715:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df602200/0x88ace7295d9e152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e14b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784806.088732:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602200/0x88ace7295d9e152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e14b expref: 21 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784806.088747:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df602200/0x88ace7295d9e152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e14b expref: 21 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784806.088754:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602200, rc 0) 00000100:00100000:1.0:1787784806.088808:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:17104:x1874627750194304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784806.088814:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787784806.089985:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750194304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784806.090003:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e152 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784806.090012:0:17104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e152 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784806.090976:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750194432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787784806.091038:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784806.092218:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa99be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784806.092456:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750194432 00000100:00100000:3.0:1787784806.092465:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750194432 00000100:00100000:3.0:1787784806.092529:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787784806.092537:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:17104:x1874627750194432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787784806.092561:0:17100:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787784806.092582:0:17100:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787784806.092586:0:17100:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787784806.092700:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:17104:x1874627750194432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784806.092708:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787784806.093165:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750194432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787784806.093698:0:17104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787784806.093709:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e152 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784806.093721:0:17104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e152 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784806.470932:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787784806.982413:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787784807.501171:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784808.522724:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784809.122473:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750194560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784809.131560:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784809.131662:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750194560 00000100:00100000:2.0:1787784809.131671:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750194560 00000100:00100000:2.0:1787784809.132159:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787784809.132172:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3271a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750194560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787784809.132358:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787784809.132485:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3271a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750194560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 316us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784809.132494:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787784809.132547:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750194560:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784809.542083:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787784809.606049:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1787784809.606051:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750194688:0@lo:400:kworker.0 00000100:00100000:2.0:1787784809.606157:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784809.606216:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784809.606222:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750194816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784809.606249:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784809.606286:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750194688 00000100:00100000:2.0:1787784809.606293:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750194688 00000100:00100000:2.0:1787784809.606340:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787784809.606347:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3644:x1874627750194688:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787784809.606408:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787784809.606409:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3644:x1874627750194688:12345-0@lo:400:kworker.0 Request processed in 59us (250us total) trans 0 rc 0/0 00000100:00080000:1.0:1787784809.606420:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1787784809.606426:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1787784809.606426:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784809.606457:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784809.606462:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784809.606466:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784809.606470:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787784809.606475:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750194816 00000100:00100000:2.0:1787784809.606482:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750194816 00000100:00100000:2.0:1787784809.606591:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787784809.606599:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3271680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750194816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784809.606625:0:17623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787784809.606744:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3271680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750194816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784809.606751:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787784809.606801:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750195200:0@lo:400:kworker.0 00000100:00100000:2.0:1787784809.606830:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784809.606867:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750194816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784809.606876:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750194688:0@lo:400:kworker.0 00000100:00100000:2.0:1787784809.606906:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750195200 00000100:00100000:2.0:1787784809.606910:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750195200 00000100:00100000:2.0:1787784809.607090:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784809.607097:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750195200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784809.607201:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750195200:12345-0@lo:400:kworker.0 Request processed in 104us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784809.607207:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787784809.607233:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951cffc8000 x1874627750195200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784809.607243:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750195200:0@lo:400:kworker.0 00000100:00100000:2.0:1787784809.607308:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750194944:0@lo:400:kworker.0 00000100:00100000:2.0:1787784809.607336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784809.607356:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784809.607362:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750195072:0@lo:400:kworker.0 00000100:00100000:2.0:1787784809.607382:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784809.607407:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750194944 00000100:00100000:2.0:1787784809.607411:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750194944 00000100:00100000:2.0:1787784809.607433:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787784809.607440:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750194944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784809.607473:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750194944:12345-0@lo:400:kworker.0 Request processed in 34us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784809.607479:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787784809.607502:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750194944:0@lo:400:kworker.0 00000100:00100000:2.0:1787784809.607535:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750195072 00000100:00100000:2.0:1787784809.607539:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750195072 00000100:00100000:2.0:1787784809.607560:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784809.607565:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750195072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784809.607598:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750195072:12345-0@lo:400:kworker.0 Request processed in 32us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784809.607604:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787784809.607627:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951cffcad00 x1874627750195072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784809.607637:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750195072:0@lo:400:kworker.0 00000100:00100000:0.0:1787784809.613511:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784809.613551:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750195328:0@lo:400:kworker.0 00000100:00100000:0.0:1787784809.613639:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784809.613864:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784809.613876:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750195456:0@lo:400:kworker.0 00000100:00100000:2.0:1787784809.613919:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784809.614039:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750195328 00000100:00100000:1.0:1787784809.614053:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750195328 00000100:00100000:0.0:1787784809.614061:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750195456 00000100:00100000:0.0:1787784809.614070:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750195456 00000100:00100000:0.0:1787784809.614196:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784809.614206:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3273840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750195456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784809.614260:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3273840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750195456:12345-0@lo:400:kworker.0 Request processed in 56us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784809.614268:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784809.614742:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784809.614754:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750195328:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787784809.616809:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784809.616819:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787784809.616875:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951cffca580 x1874627750195456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784809.616892:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750195456:0@lo:400:kworker.0 00010000:00080000:0.0:1787784809.619846:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951cffc9a40 x1874627750195328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784809.619863:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750195328:0@lo:400:kworker.0 00000100:00100000:1.0:1787784809.620054:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750195328:12345-0@lo:400:kworker.0 Request processed in 5294us (6407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784809.620211:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:1.0:1787784810.315856:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787784810.566234:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784811.590500:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787784812.481914:0:18979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787784812.615778:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784813.445864:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784798/real 1787784798] req@ffff8951ff47cf00 x1874627750188800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784813 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784813.445898:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951ff47cf00 x1874627750188800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784813 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784813.445910:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784798/real 1787784798] req@ffff8951ff47c3c0 x1874627750188928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784813 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784813.445921:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951ff47c3c0 x1874627750188928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784813 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787784813.445943:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c2cc4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784813.445968:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787784813.445973:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750188800:0@lo:8:kworker.0 00000100:00080000:2.0:1787784813.445988:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784813.445994:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787784813.445998:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750188928:0@lo:8:kworker.0 00000100:00080000:1.0:1787784813.446218:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784813.446223:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784813.446225:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784813.446229:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784813.446246:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784813.446249:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787784813.446265:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951c2cc4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784813.446270:0:15021:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 538 00000100:00080000:1.0:1787784813.446275:0:15021:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787784813.446281:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8951c2cc4800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784813.446299:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951cffcad00 x1874627750196096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784813.446310:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784813.446312:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787784813.446313:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784813.446316:0:15021:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 538 00000100:00080000:1.0:1787784813.446319:0:15021:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787784813.446322:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8951cfe44000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784813.446331:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951cffc83c0 x1874627750196224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784813.446514:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750195584:0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.446579:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784813.446642:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750196352:0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.446678:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784813.446702:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784813.446708:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750195968:0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.446732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784813.446800:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750195840:0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.446826:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784813.446845:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750196608:0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.446863:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784813.446881:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787784813.446887:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750195712:0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.446906:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784813.446922:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750196480:0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.446942:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784813.446970:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750196352 00000100:00100000:2.0:1787784813.446977:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750196352 00000100:00100000:2.0:1787784813.447255:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750195840 00000100:00100000:2.0:1787784813.447259:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750195840 00000100:00100000:2.0:1787784813.447270:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750196608 00000100:00100000:2.0:1787784813.447273:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750196608 00000100:00100000:2.0:1787784813.447295:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750196480 00000100:00100000:2.0:1787784813.447297:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750196480 00000100:00100000:2.0:1787784813.447312:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784813.447320:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750196352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.447370:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750196352:12345-0@lo:400:kworker.0 Request processed in 50us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784813.447377:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784813.447394:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787784813.447410:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750195840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.447443:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750195840:12345-0@lo:400:kworker.0 Request processed in 35us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784813.447449:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787784813.447460:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787784813.447466:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750196608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.447492:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874627750196608:12345-0@lo:400:kworker.0 Request processed in 27us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784813.447498:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787784813.447509:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787784813.447514:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1196580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750196480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.447537:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1196580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750196480:12345-0@lo:400:kworker.0 Request processed in 24us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784813.447543:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787784813.447563:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750195968 00000100:00100000:2.0:1787784813.447567:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750195968 00000100:00100000:2.0:1787784813.447588:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750195712 00000100:00100000:2.0:1787784813.447591:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750195712 00000100:00100000:2.0:1787784813.447602:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787784813.447607:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750195968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.447648:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750195968:12345-0@lo:400:kworker.0 Request processed in 40us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784813.447654:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787784813.447666:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787784813.447671:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3273c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750195712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.447696:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3273c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750195712:12345-0@lo:400:kworker.0 Request processed in 25us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784813.447707:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787784813.447736:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784813.447740:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787784813.447871:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750195584 00000100:00100000:1.0:1787784813.447875:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750195584 00000100:00100000:1.0:1787784813.447906:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787784813.447913:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3647:x1874627750195584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784813.447948:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3647:x1874627750195584:12345-0@lo:400:kworker.0 Request processed in 36us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784813.447954:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787784813.449202:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750195712:0@lo:400:kworker.0 00010000:00080000:2.0:1787784813.449225:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951cffc92c0 x1874627750196480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784813.449237:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750196480:0@lo:400:kworker.0 00010000:00080000:2.0:1787784813.449248:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951cffc9a40 x1874627750195840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784813.449258:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750195840:0@lo:400:kworker.0 00010000:00080000:2.0:1787784813.449268:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951cffca940 x1874627750196608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784813.449276:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874627750196608:0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.449318:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750196096:0@lo:8:kworker.0 00000100:00100000:2.0:1787784813.449376:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784813.449422:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750196224:0@lo:8:kworker.0 00000100:00100000:2.0:1787784813.449443:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784813.449491:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750195968:0@lo:400:kworker.0 00000100:00100000:2.0:1787784813.449502:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750195584:0@lo:400:kworker.0 00010000:00080000:2.0:1787784813.449513:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951cffc8000 x1874627750196352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784813.449521:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750196352:0@lo:400:kworker.0 00000100:00100000:1.0:1787784813.453660:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750196096 00000100:00100000:1.0:1787784813.453675:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750196096 00000100:00100000:1.0:1787784813.453712:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750196224 00000100:00100000:1.0:1787784813.453715:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750196224 00000100:00100000:1.0:1787784813.453731:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784813.453739:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4165a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1874627750196096:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787784813.453817:0:18612:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:1.0:1787784813.453846:0:18612:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9e159 00002000:00100000:1.0:1787784813.453862:0:18612:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8950c2644800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787784813.453866:0:18612:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787784813.453869:0:18612:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787784813.454059:0:18612:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787784813.454087:0:18612:0:(import.c:65:import_set_state_nolock()) ffff8950c2641000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784813.454193:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4165a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1874627750196096:12345-0@lo:8:kworker.0 Request processed in 454us (4816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784813.454201:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784813.454218:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784813.454223:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4166d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1874627750196224:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787784813.454235:0:18612:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1787784813.457481:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951cffcad00 x1874627750196096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784813.457498:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787784813.457509:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787784813.457518:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787784813.457525:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787784813.457529:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c2cc4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787784813.457544:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787784813.457550:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750196096:0@lo:8:kworker.0 00000004:00080000:3.0:1787784813.457619:0:17849:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787784813.457642:0:17849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5290b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17849:1874627750196864:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787784813.457702:0:17849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784813.457725:0:17849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa994180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784813.457739:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750196736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784813.457763:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784813.458442:0:18614:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787784813.458453:0:18614:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:2.0:1787784813.458483:0:17848:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787784813.458577:0:17848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 553707808089ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787784813.458584:0:17848:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787784813.458620:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750196736 00000100:00100000:2.0:1787784813.458627:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750196736 00000100:00100000:2.0:1787784813.458677:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784813.458686:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1874627750196736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784813.458714:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784813.458793:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1874627750196736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784813.458801:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787784813.459040:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787784813.459068:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f5293480 x1874627750196736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784813.459085:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750196736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784813.459542:0:18613:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787784813.459555:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750196864 00000100:00100000:0.0:1787784813.459560:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750196864 00000100:00100000:3.0:1787784813.475519:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784813.475540:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5292d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17849:x1874627750196864:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787784813.486467:0:17840:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787784813.496159:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4166d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1874627750196224:12345-0@lo:8:kworker.0 Request processed in 41927us (46706us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784813.496174:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787784813.496234:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784813.496239:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787784813.496243:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750196224:0@lo:8:kworker.0 00002000:00080000:0.0:1787784813.505752:0:19016:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787784813.505789:0:19016:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787784813.505900:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5292d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17849:x1874627750196864:12345-0@lo:7:osp-pre-0-1.0 Request processed in 30362us (48193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784813.505911:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787784813.506135:0:17849:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f5290b40 x1874627750196864/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787784829 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784813.506160:0:17849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5290b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17849:1874627750196864:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787784813.506174:0:17849:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787784813.506214:0:17849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4165e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17849:1874627750196992:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787784813.506250:0:17849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784813.506281:0:17849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0a31240 going to sleep for 11 seconds 00000100:00100000:0.0:1787784813.506993:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750196992 00000100:00100000:0.0:1787784813.507000:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750196992 00000100:00100000:0.0:1787784813.507040:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784813.507047:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17849:x1874627750196992:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787784813.507072:0:18613:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1787784813.507123:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17849:x1874627750196992:12345-0@lo:5:osp-pre-0-1.0 Request processed in 75us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784813.507130:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787784813.509068:0:17849:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c4165e00 x1874627750196992/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784829 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784813.509113:0:17849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4165e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17849:1874627750196992:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787784813.509128:0:17849:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787784813.509184:0:17849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4165e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17849:1874627750197120:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787784813.509230:0:17849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784813.509266:0:17849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0a31240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784813.513580:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750197120 00000100:00100000:3.0:1787784813.513596:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750197120 00000100:00100000:3.0:1787784813.513664:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784813.513675:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c41670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17849:x1874627750197120:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787784813.513721:0:18612:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1787784813.581262:0:18609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787784813.581279:0:18609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787784813.585697:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c41670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17849:x1874627750197120:12345-0@lo:5:osp-pre-0-1.0 Request processed in 72015us (76455us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787784813.585712:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787784813.585785:0:17849:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c4165e00 x1874627750197120/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784829 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784813.585798:0:17849:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787784813.585804:0:17849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4165e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17849:1874627750197120:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787784813.585820:0:17849:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1787784813.585873:0:17849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4165e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17849:1874627750197248:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787784813.585908:0:17849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784813.585942:0:17849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0a31240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784813.586469:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750197248 00000100:00100000:3.0:1787784813.586476:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750197248 00000100:00100000:3.0:1787784813.586514:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784813.586522:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4165680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17849:x1874627750197248:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787784813.586573:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4165680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17849:x1874627750197248:12345-0@lo:900:osp-pre-0-1.0 Request processed in 52us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784813.586579:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787784813.586608:0:17849:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c4165e00 x1874627750197248/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787784829 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784813.586625:0:17849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4165e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17849:1874627750197248:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1787784813.644320:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787784813.685302:0:19032:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787784813.685513:0:19032:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787784814.214038:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784814.214061:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750197376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784814.214155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784814.214455:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750197376 00000100:00100000:1.0:1787784814.214462:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750197376 00000100:00100000:1.0:1787784814.214512:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787784814.214521:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750197376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787784814.214554:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787784814.214606:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750197376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784814.214626:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787784814.214674:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750197376:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787784814.663608:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784814.726197:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784814.726225:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750197504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784814.726293:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784814.726462:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750197504 00000100:00100000:0.0:1787784814.726470:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750197504 00000100:00100000:0.0:1787784814.726526:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787784814.726535:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750197504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784814.726570:0:17623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787784814.726628:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750197504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784814.726646:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787784814.726845:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750197504:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1787784815.027384:0:19082:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787784815.027603:0:19082:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787784815.686155:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787784816.198751:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787784816.713510:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784817.734218:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784818.763104:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787784818.822619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784818.822633:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784818.822636:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784818.822639:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784818.822665:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784818.822668:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787784818.822671:0:37:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784818.822678:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 553 00000100:00080000:0.0:1787784818.822684:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787784818.822690:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8951cfe44000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784818.822709:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff47da40 x1874627750198272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784818.822755:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750197760:0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.823120:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750198016:0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.823194:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784818.823246:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750198656:0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.823269:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784818.823294:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787784818.823300:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750197632:0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.823328:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784818.823352:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750198144:0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.823374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784818.823407:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750198016 00000100:00100000:1.0:1787784818.823414:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750198016 00000100:00100000:1.0:1787784818.823457:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787784818.823465:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750198016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.823513:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750198016:12345-0@lo:400:kworker.0 Request processed in 48us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784818.823520:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787784818.823541:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750198656 00000100:00100000:1.0:1787784818.823544:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750198656 00000100:00100000:1.0:1787784818.823574:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787784818.823580:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750198656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.823606:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750198656:12345-0@lo:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784818.823611:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787784818.823639:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750197632 00000100:00100000:1.0:1787784818.823643:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750197632 00000100:00100000:1.0:1787784818.823665:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787784818.823671:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3644:x1874627750197632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.823702:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3644:x1874627750197632:12345-0@lo:400:kworker.0 Request processed in 31us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784818.823707:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787784818.823747:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750197632:0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.823757:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750198016:0@lo:400:kworker.0 00010000:00080000:1.0:1787784818.824983:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951ff47e1c0 x1874627750198656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784818.825004:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750198656:0@lo:400:kworker.0 00000100:00080000:1.0:1787784818.825041:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784818.825321:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784818.825335:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750198784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784818.825386:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784818.825426:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750198784 00000100:00100000:3.0:1787784818.825432:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750198784 00000100:00100000:3.0:1787784818.825474:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784818.825482:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750198784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784818.825508:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787784818.825555:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750198784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784818.825562:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787784818.825581:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787784818.825604:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951f5293840 x1874627750198784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784818.825617:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750198784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784818.825701:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784818.825736:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750198400:0@lo:400:kworker.0 00000100:00100000:0.0:1787784818.825760:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784818.825812:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787784818.825973:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750197888:0@lo:400:kworker.0 00000100:00100000:0.0:1787784818.826002:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784818.826023:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750198528:0@lo:400:kworker.0 00000100:00100000:0.0:1787784818.826044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784818.826089:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750198272:0@lo:8:kworker.0 00000100:00100000:0.0:1787784818.826118:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784818.826278:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750198144 00000100:00100000:0.0:1787784818.826284:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750198144 00000100:00100000:0.0:1787784818.826327:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750198272 00000100:00100000:0.0:1787784818.826331:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750198272 00000100:00100000:0.0:1787784818.826347:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784818.826354:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750198144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784818.826397:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750198144:12345-0@lo:400:kworker.0 Request processed in 43us (3021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784818.826403:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784818.826416:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784818.826420:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1874627750198272:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787784818.826436:0:18613:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787784818.827039:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750197760 00000100:00100000:3.0:1787784818.827045:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750197760 00000100:00100000:3.0:1787784818.827090:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784818.827098:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750197760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784818.827229:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750197760:12345-0@lo:400:kworker.0 Request processed in 132us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784818.827237:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787784818.829875:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750198400 00000100:00100000:1.0:1787784818.829889:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750198400 00000100:00100000:1.0:1787784818.829939:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750197888 00000100:00100000:1.0:1787784818.829942:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750197888 00000100:00100000:1.0:1787784818.829956:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750198528 00000100:00100000:1.0:1787784818.829958:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750198528 00000100:00100000:1.0:1787784818.829986:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787784818.829995:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750198400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.830080:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750198400:12345-0@lo:400:kworker.0 Request processed in 86us (4319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784818.830087:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787784818.830105:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784818.830111:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750197888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.830350:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750197888:12345-0@lo:400:kworker.0 Request processed in 239us (4347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784818.830357:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784818.830370:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787784818.830376:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750198528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.830400:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750198528:12345-0@lo:400:kworker.0 Request processed in 25us (4356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784818.830405:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787784818.830433:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787784818.833317:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951ff47cf00 x1874627750198144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784818.833339:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750198144:0@lo:400:kworker.0 00010000:00080000:1.0:1787784818.834150:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c3272580 x1874627750197888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784818.834164:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750197888:0@lo:400:kworker.0 00010000:00080000:1.0:1787784818.834180:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951ff47c780 x1874627750198528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784818.834189:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750198528:0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.834203:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750197760:0@lo:400:kworker.0 00010000:00080000:1.0:1787784818.834214:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951ff47fc00 x1874627750198400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784818.834223:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750198400:0@lo:400:kworker.0 00000100:00100000:1.0:1787784818.868344:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1874627750198272:12345-0@lo:8:kworker.0 Request processed in 41912us (42215us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784818.868358:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787784818.876632:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784818.876652:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787784818.876659:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750198272:0@lo:8:kworker.0 00000100:00100000:0.0:1787784819.344968:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750198912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784819.345083:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784819.345671:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750198912 00000100:00100000:3.0:1787784819.345684:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750198912 00000100:00100000:3.0:1787784819.346016:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787784819.346029:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750198912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784819.346086:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787784819.346160:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750198912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784819.346168:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787784819.346233:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750198912:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787784819.784155:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784819.846433:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4166580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750199040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784819.846508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784819.846611:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750199040 00000100:00100000:2.0:1787784819.846619:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750199040 00000100:00100000:2.0:1787784819.846670:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787784819.846681:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5293840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750199040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784819.846736:0:17623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787784819.846802:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5293840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750199040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784819.846809:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787784819.848627:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4166580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750199040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784819.851432:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784799/real 1787784799] req@ffff8951d9e130c0 x1874627750189568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784819 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784819.851465:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951d9e130c0 x1874627750189568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784819 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784819.851476:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784799/real 1787784799] req@ffff8951d9e112c0 x1874627750189696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784819 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784819.851488:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951d9e112c0 x1874627750189696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784819 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787784819.851505:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c642d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787784819.851968:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787784819.851974:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750189568:0@lo:8:kworker.0 00000100:00080000:3.0:1787784819.851981:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787784819.851987:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787784819.851990:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750189696:0@lo:8:kworker.0 00000100:00080000:2.0:1787784819.852859:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784819.852939:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787784819.852942:0:37:0:(import.c:65:import_set_state_nolock()) ffff8951c642d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784819.852949:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:2.0:1787784819.852954:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787784819.852961:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8951c642d800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784819.852984:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c41652c0 x1874627750199296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784819.852998:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784819.853002:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787784819.853003:0:37:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784819.853007:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:2.0:1787784819.853009:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787784819.853012:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8951c3238800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784819.853023:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c4164f00 x1874627750199424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784819.853572:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784819.853575:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787784819.853577:0:37:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784819.853581:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 559 00000100:00080000:2.0:1787784819.853598:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787784819.853603:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8951cfe44000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784819.853618:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c4166580 x1874627750199936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784819.853669:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750199552:0@lo:400:kworker.0 00000100:00100000:2.0:1787784819.853734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784819.855379:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4167840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750199168:0@lo:400:kworker.0 00000100:00100000:3.0:1787784819.855438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784819.857158:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c41661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750200192:0@lo:400:kworker.0 00000100:00100000:2.0:1787784819.857217:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784819.857277:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750199552 00000100:00100000:2.0:1787784819.857285:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750199552 00000100:00100000:2.0:1787784819.857327:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750200192 00000100:00100000:2.0:1787784819.857330:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750200192 00000100:00100000:2.0:1787784819.857353:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784819.857363:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4165e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750199552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784819.857415:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4165e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750199552:12345-0@lo:400:kworker.0 Request processed in 53us (3680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784819.857422:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784819.857438:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787784819.857444:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750200192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784819.857471:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750200192:12345-0@lo:400:kworker.0 Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784819.857477:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787784819.857526:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c4167480 x1874627750199552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784819.857541:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750199552:0@lo:400:kworker.0 00010000:00080000:2.0:1787784819.857559:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c41661c0 x1874627750200192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784819.857568:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c41661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750200192:0@lo:400:kworker.0 00000100:00100000:2.0:1787784819.858341:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4167c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750199680:0@lo:400:kworker.0 00000100:00100000:2.0:1787784819.858381:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784819.858414:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4166940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750200320:0@lo:400:kworker.0 00000100:00100000:2.0:1787784819.858435:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784819.858455:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784819.858461:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750199808:0@lo:400:kworker.0 00000100:00100000:2.0:1787784819.858483:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784819.858511:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750199808 00000100:00100000:2.0:1787784819.858516:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750199808 00000100:00100000:2.0:1787784819.858548:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784819.858556:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750199808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784819.858592:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750199808:12345-0@lo:400:kworker.0 Request processed in 37us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784819.858599:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787784819.858628:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c4164000 x1874627750199808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784819.858638:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750199808:0@lo:400:kworker.0 00000100:00100000:2.0:1787784819.858656:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c41652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750199296:0@lo:8:kworker.0 00000100:00100000:2.0:1787784819.858697:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784819.858736:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4164f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750199424:0@lo:8:kworker.0 00000100:00100000:2.0:1787784819.858763:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784819.858806:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4166580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750199936:0@lo:8:kworker.0 00000100:00100000:2.0:1787784819.858827:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784819.858854:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750199296 00000100:00100000:2.0:1787784819.858858:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750199296 00000100:00100000:2.0:1787784819.858872:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750199424 00000100:00100000:2.0:1787784819.858875:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750199424 00000100:00100000:2.0:1787784819.858882:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750199936 00000100:00100000:2.0:1787784819.858884:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750199936 00000100:00100000:2.0:1787784819.858892:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784819.858896:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750199296:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787784819.859057:0:18614:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:2.0:1787784819.859083:0:18614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9e160 00002000:00100000:2.0:1787784819.859098:0:18614:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8951c41dc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787784819.859102:0:18614:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787784819.859104:0:18614:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787784819.859174:0:18614:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787784819.859195:0:18614:0:(import.c:65:import_set_state_nolock()) ffff8951c41da800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784819.859234:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1874627750199296:12345-0@lo:8:kworker.0 Request processed in 336us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784819.859241:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784819.859254:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784819.859257:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750199424:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787784819.859268:0:18614:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787784819.859309:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750199424:12345-0@lo:8:kworker.0 Request processed in 49us (544us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787784819.859315:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784819.859326:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784819.859336:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750199936:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787784819.859345:0:18614:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787784819.859370:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750199936:12345-0@lo:8:kworker.0 Request processed in 33us (541us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787784819.859375:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784819.859398:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750200320 00000100:00100000:2.0:1787784819.859402:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750200320 00000100:00100000:2.0:1787784819.859429:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787784819.859435:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750200320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784819.859466:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750200320:12345-0@lo:400:kworker.0 Request processed in 32us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784819.859472:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787784819.859498:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c4166940 x1874627750200320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784819.859507:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4166940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750200320:0@lo:400:kworker.0 00010000:00080000:2.0:1787784819.859526:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c41652c0 x1874627750199296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784819.859533:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784819.859538:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787784819.859545:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787784819.859550:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787784819.859553:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c642d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787784819.859566:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787784819.859571:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c41652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750199296:0@lo:8:kworker.0 00000100:00080000:2.0:1787784819.859581:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784819.859590:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787784819.859593:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4164f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750199424:0@lo:8:kworker.0 00000100:00080000:2.0:1787784819.859602:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784819.859605:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787784819.859608:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4166580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750199936:0@lo:8:kworker.0 00000004:00080000:2.0:1787784819.859651:0:17132:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1787784819.859667:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17132:1874627750200576:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787784819.859691:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784819.859721:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d249a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784819.859732:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784819.859739:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750200448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784819.859760:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784819.859799:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750200576 00000100:00100000:2.0:1787784819.859803:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750200576 00000100:00100000:2.0:1787784819.859829:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787784819.859835:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17132:x1874627750200576:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1787784819.861119:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784819.864212:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750199680 00000100:00100000:3.0:1787784819.864229:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750199680 00000100:00100000:3.0:1787784819.864354:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787784819.864376:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750199680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784819.864475:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750199680:12345-0@lo:400:kworker.0 Request processed in 102us (6093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784819.864482:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787784819.864509:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750199168 00000100:00100000:3.0:1787784819.864513:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750199168 00000100:00100000:3.0:1787784819.864540:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787784819.864547:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3644:x1874627750199168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784819.864581:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3644:x1874627750199168:12345-0@lo:400:kworker.0 Request processed in 35us (9143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784819.864587:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000004:00080000:3.0:1787784819.864618:0:17131:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787784819.864706:0:17131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 560113937536ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787784819.864713:0:17131:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787784819.865247:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750200448 00000100:00100000:3.0:1787784819.865252:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750200448 00000100:00100000:3.0:1787784819.866354:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784819.866369:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874627750200448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784819.866394:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787784819.866455:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874627750200448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (6693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784819.866462:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787784819.866552:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c43b1e00 x1874627750200448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784819.866573:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750200448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784819.866586:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4167c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750199680:0@lo:400:kworker.0 00000100:00100000:3.0:1787784819.866645:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4167840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750199168:0@lo:400:kworker.0 00000100:00100000:3.0:1787784819.866656:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c41643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750200064:0@lo:400:kworker.0 00000100:00100000:3.0:1787784819.866690:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784819.866723:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750200064 00000100:00100000:3.0:1787784819.866729:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750200064 00000100:00100000:3.0:1787784819.866755:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787784819.866761:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750200064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784819.867356:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750200064:12345-0@lo:400:kworker.0 Request processed in 593us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784819.867365:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787784819.867407:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c41643c0 x1874627750200064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784819.867417:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c41643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750200064:0@lo:400:kworker.0 00000004:00080000:0.0:1787784819.877127:0:17087:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1787784819.879021:0:18614:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787784819.879034:0:18614:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787784819.879041:0:18614:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:2.0:1787784819.887412:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784819.887429:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002adcee5b/0x88ace7295d9e167 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.887453:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1787784819.887459:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784819.887490:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002adcee5b/0x88ace7295d9e167 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.887515:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002adcee5b/0x88ace7295d9e167 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.887528:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002adcee5b/0x88ace7295d9e167 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.887537:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002adcee5b/0x88ace7295d9e167 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.887564:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784819.887596:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784819.887608:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002adcee5b/0x88ace7295d9e167 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.887622:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784819.887627:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002adcee5b/0x88ace7295d9e167 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.887643:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002adcee5b/0x88ace7295d9e167 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.887685:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002adcee5b/0x88ace7295d9e167 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.887695:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002adcee5b/0x88ace7295d9e167 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.887721:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784819.887723:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784819.887726:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784819.888401:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784819.888410:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f262aad/0x88ace7295d9e16e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.888422:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1787784819.888427:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784819.888432:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f262aad/0x88ace7295d9e16e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.888442:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f262aad/0x88ace7295d9e16e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.888451:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f262aad/0x88ace7295d9e16e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.888469:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f262aad/0x88ace7295d9e16e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.888557:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784819.889115:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784819.889135:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f262aad/0x88ace7295d9e16e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.889145:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.889150:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f262aad/0x88ace7295d9e16e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.889161:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f262aad/0x88ace7295d9e16e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.889186:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f262aad/0x88ace7295d9e16e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.889204:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f262aad/0x88ace7295d9e16e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.889231:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.889234:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.889237:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784819.889874:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784819.889883:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b43cff24/0x88ace7295d9e175 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.889896:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1787784819.889901:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784819.889907:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b43cff24/0x88ace7295d9e175 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.889932:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b43cff24/0x88ace7295d9e175 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.889943:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b43cff24/0x88ace7295d9e175 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.889952:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b43cff24/0x88ace7295d9e175 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.890253:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787784819.890812:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784819.890821:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002eef094/0x88ace7295d9e17c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.890844:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1787784819.890849:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784819.890855:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002eef094/0x88ace7295d9e17c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.890866:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002eef094/0x88ace7295d9e17c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.890877:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002eef094/0x88ace7295d9e17c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.890885:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002eef094/0x88ace7295d9e17c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.891088:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784819.891098:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b43cff24/0x88ace7295d9e175 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.891109:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.891113:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b43cff24/0x88ace7295d9e175 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.891134:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b43cff24/0x88ace7295d9e175 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.891156:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b43cff24/0x88ace7295d9e175 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.891165:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b43cff24/0x88ace7295d9e175 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.891200:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784819.891204:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002eef094/0x88ace7295d9e17c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.891220:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.891224:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002eef094/0x88ace7295d9e17c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.891232:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002eef094/0x88ace7295d9e17c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.891244:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002eef094/0x88ace7295d9e17c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.891259:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.891261:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.891333:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784819.891486:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787784819.891493:0:18614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002eef094/0x88ace7295d9e17c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787784819.892093:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787784819.892117:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e183 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.892136:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1787784819.892141:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784819.892147:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e183 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.892163:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e183 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.892174:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e183 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.892182:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e183 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.892251:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784819.892260:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e183 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.892269:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.892273:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e183 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.892284:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e183 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.892298:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e183 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.892317:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.892319:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.892321:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784819.892612:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787784819.892619:0:18614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e183 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.892639:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787784819.894394:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787784819.894408:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cfb3b7b/0x88ace7295d9e18a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.894426:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1787784819.894432:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784819.894447:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cfb3b7b/0x88ace7295d9e18a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.894463:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cfb3b7b/0x88ace7295d9e18a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.894487:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cfb3b7b/0x88ace7295d9e18a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.894497:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cfb3b7b/0x88ace7295d9e18a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.894519:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784819.894963:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784819.895089:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cfb3b7b/0x88ace7295d9e18a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.895100:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.895105:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cfb3b7b/0x88ace7295d9e18a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.895116:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cfb3b7b/0x88ace7295d9e18a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.897996:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cfb3b7b/0x88ace7295d9e18a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.898014:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cfb3b7b/0x88ace7295d9e18a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.898058:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.898062:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.898066:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787784819.900028:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787784819.900045:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000887f20b1/0x88ace7295d9e191 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.900075:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1787784819.900081:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784819.900089:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000887f20b1/0x88ace7295d9e191 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.900106:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000887f20b1/0x88ace7295d9e191 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.900118:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000887f20b1/0x88ace7295d9e191 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.900381:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000887f20b1/0x88ace7295d9e191 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.900443:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787784819.902519:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787784819.902536:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e198 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.902556:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1787784819.902562:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784819.902570:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e198 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.902587:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e198 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.902598:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e198 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.902607:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e198 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.904825:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784819.904843:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000887f20b1/0x88ace7295d9e191 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.904869:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.904874:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000887f20b1/0x88ace7295d9e191 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.904888:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000887f20b1/0x88ace7295d9e191 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.904915:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000887f20b1/0x88ace7295d9e191 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.904924:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000887f20b1/0x88ace7295d9e191 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.904947:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784819.904951:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e198 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.904958:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.904961:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e198 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.904969:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e198 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.904980:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e198 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.904994:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.904996:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.904999:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784819.906190:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787784819.906203:0:18614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e198 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.906870:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787784819.910868:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787784819.910884:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9e19f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.910904:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1787784819.910909:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784819.910915:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9e19f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.910928:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9e19f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.910938:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9e19f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.910945:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9e19f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.910967:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784819.911020:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784819.911036:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9e19f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.911063:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.911070:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9e19f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.911084:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9e19f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.911113:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9e19f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.911122:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca6e9e52/0x88ace7295d9e19f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.911147:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.911150:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.911152:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787784819.911975:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787784819.911985:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9e1a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.911997:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1787784819.912001:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784819.912012:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9e1a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.912023:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9e1a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.912032:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9e1a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.912038:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9e1a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.912067:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784819.912099:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784819.912109:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9e1a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.912136:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.912141:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9e1a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.912150:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9e1a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.912167:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9e1a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.912175:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa7317df/0x88ace7295d9e1a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.912198:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.912200:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.912202:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787784819.912922:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787784819.912932:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057e88a34/0x88ace7295d9e1ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.912944:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1787784819.912947:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784819.912952:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057e88a34/0x88ace7295d9e1ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.912962:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057e88a34/0x88ace7295d9e1ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.913172:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057e88a34/0x88ace7295d9e1ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.913194:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057e88a34/0x88ace7295d9e1ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.913217:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784819.913270:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784819.913279:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057e88a34/0x88ace7295d9e1ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.913290:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.913305:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057e88a34/0x88ace7295d9e1ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.913317:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057e88a34/0x88ace7295d9e1ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.913346:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057e88a34/0x88ace7295d9e1ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.913355:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057e88a34/0x88ace7295d9e1ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.913384:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.913386:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.913388:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787784819.913713:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787784819.913720:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e1b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.913732:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1787784819.913737:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784819.913744:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e1b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.913757:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e1b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.913794:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e1b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.913803:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e1b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.913826:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784819.913849:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784819.913854:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e1b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.913862:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.913865:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e1b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.913872:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e1b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.913883:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e1b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.913890:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e1b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.913918:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.913920:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.913922:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787784819.915599:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787784819.915615:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e1bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.915642:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1787784819.915647:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784819.915655:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e1bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.915669:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e1bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.915679:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e1bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.915687:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e1bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.916197:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784819.916220:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784819.916235:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e1bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.916249:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784819.916255:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e1bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.916266:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e1bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.916288:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e1bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.916296:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e1bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.916333:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784819.916335:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784819.916337:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784819.918092:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784819.918104:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c39ab272/0x88ace7295d9e1c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.918121:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=560s v=(0 0) 00010000:00010000:0.0:1787784819.918126:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784819.918133:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c39ab272/0x88ace7295d9e1c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.918145:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c39ab272/0x88ace7295d9e1c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.918154:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c39ab272/0x88ace7295d9e1c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.918161:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c39ab272/0x88ace7295d9e1c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.918181:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784819.918457:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784819.918465:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c39ab272/0x88ace7295d9e1c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.918473:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.918477:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c39ab272/0x88ace7295d9e1c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.918486:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c39ab272/0x88ace7295d9e1c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.918501:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c39ab272/0x88ace7295d9e1c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.918508:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c39ab272/0x88ace7295d9e1c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.918524:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.918526:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.918528:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784819.920132:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784819.920142:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9e1c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.920165:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=560s v=(0 0) 00010000:00010000:0.0:1787784819.920168:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784819.920172:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9e1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.920181:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9e1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.920188:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9e1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.920193:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9e1c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.920207:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784819.920589:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784819.920594:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9e1c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.920609:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.920612:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9e1c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.920619:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9e1c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.920631:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9e1c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.920635:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9e1c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.920649:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.920651:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.920652:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784819.920717:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784819.920721:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091e4dfb3/0x88ace7295d9e1d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.920727:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=560s v=(0 0) 00010000:00010000:0.0:1787784819.920729:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784819.920732:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091e4dfb3/0x88ace7295d9e1d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.920738:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091e4dfb3/0x88ace7295d9e1d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.920751:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091e4dfb3/0x88ace7295d9e1d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.920755:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091e4dfb3/0x88ace7295d9e1d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.920848:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787784819.921290:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784819.921303:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.921321:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=560s v=(0 0) 00010000:00010000:0.0:1787784819.921326:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784819.921333:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.921347:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.921358:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.921367:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.921622:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784819.921630:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091e4dfb3/0x88ace7295d9e1d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.921640:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.921643:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091e4dfb3/0x88ace7295d9e1d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.921652:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091e4dfb3/0x88ace7295d9e1d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.921683:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091e4dfb3/0x88ace7295d9e1d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.921692:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091e4dfb3/0x88ace7295d9e1d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.921707:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784819.921710:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.921714:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.921716:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.921720:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.921727:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1d7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.921731:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.921732:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.921734:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.926749:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784819.926907:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787784819.927446:0:18614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784819.929492:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784819.929510:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e1de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.929532:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=560s v=(0 0) 00010000:00010000:0.0:1787784819.929538:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784819.929546:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e1de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.929563:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e1de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.929574:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e1de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.929584:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e1de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.929620:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784819.930372:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784819.930387:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e1de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.930412:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784819.930417:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e1de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.930431:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e1de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.930450:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e1de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.930720:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e1de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784819.930741:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.930742:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.930743:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784819.933444:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784819.933464:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002da14848/0x88ace7295d9e1e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.933501:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=560s v=(0 0) 00010000:00010000:0.0:1787784819.933507:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784819.933516:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002da14848/0x88ace7295d9e1e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.933534:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002da14848/0x88ace7295d9e1e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.933546:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002da14848/0x88ace7295d9e1e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.933555:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002da14848/0x88ace7295d9e1e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.933628:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787784819.934321:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784819.934330:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937d2f8a/0x88ace7295d9e1ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.934342:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=560s v=(0 0) 00010000:00010000:0.0:1787784819.934345:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784819.934351:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000937d2f8a/0x88ace7295d9e1ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.934361:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000937d2f8a/0x88ace7295d9e1ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.934382:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937d2f8a/0x88ace7295d9e1ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.934389:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000937d2f8a/0x88ace7295d9e1ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.934508:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784819.934519:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002da14848/0x88ace7295d9e1e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.934528:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784819.934533:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002da14848/0x88ace7295d9e1e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.934543:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002da14848/0x88ace7295d9e1e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.934576:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002da14848/0x88ace7295d9e1e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.934583:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002da14848/0x88ace7295d9e1e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.934606:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784819.934610:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000937d2f8a/0x88ace7295d9e1ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.934618:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784819.934621:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000937d2f8a/0x88ace7295d9e1ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.934629:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000937d2f8a/0x88ace7295d9e1ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.934638:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000937d2f8a/0x88ace7295d9e1ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.934646:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784819.934648:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784819.934650:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784819.934696:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787784819.934823:0:18614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000937d2f8a/0x88ace7295d9e1ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.935070:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784819.940840:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784819.940861:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.940886:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=560s v=(0 0) 00010000:00010000:0.0:1787784819.940893:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784819.940901:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.940920:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.940932:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.940959:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.942122:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784819.942563:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784819.942575:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.942601:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784819.942607:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.942620:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.942644:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.942652:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b97ff9bb/0x88ace7295d9e1f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.942684:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784819.942686:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784819.942688:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784819.947248:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784819.947263:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8f17702/0x88ace7295d9e1fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.947281:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=560s v=(0 0) 00010000:00010000:0.0:1787784819.947287:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784819.947292:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8f17702/0x88ace7295d9e1fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.947306:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8f17702/0x88ace7295d9e1fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.947315:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8f17702/0x88ace7295d9e1fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.947320:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8f17702/0x88ace7295d9e1fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.947342:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787784819.948111:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784819.948121:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e201 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.948275:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=560s v=(0 0) 00010000:00010000:0.0:1787784819.948279:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784819.948284:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e201 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.948296:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e201 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.948306:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e201 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.948314:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e201 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.948337:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787784819.948516:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784819.948526:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8f17702/0x88ace7295d9e1fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.948537:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784819.948541:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8f17702/0x88ace7295d9e1fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.948550:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8f17702/0x88ace7295d9e1fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.948576:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8f17702/0x88ace7295d9e1fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.948585:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8f17702/0x88ace7295d9e1fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.948603:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784819.948607:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e201 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.948613:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784819.948616:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e201 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.948623:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e201 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.948632:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e201 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.948639:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a08dd2cc/0x88ace7295d9e201 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.948651:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784819.948652:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784819.948659:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784819.948897:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787784819.950365:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787784819.950377:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc32cea/0x88ace7295d9e208 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.950395:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1787784819.950400:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784819.950408:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fc32cea/0x88ace7295d9e208 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.950423:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fc32cea/0x88ace7295d9e208 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.950433:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc32cea/0x88ace7295d9e208 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.950440:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fc32cea/0x88ace7295d9e208 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.950499:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784819.951235:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784819.951248:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fc32cea/0x88ace7295d9e208 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.951257:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784819.951263:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc32cea/0x88ace7295d9e208 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.951273:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc32cea/0x88ace7295d9e208 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.951307:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fc32cea/0x88ace7295d9e208 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.951316:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fc32cea/0x88ace7295d9e208 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.951332:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784819.951334:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784819.951336:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787784819.951397:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787784819.951402:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9e20f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.951410:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1787784819.951413:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784819.951417:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9e20f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.951432:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9e20f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.951439:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9e20f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.951443:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9e20f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.951457:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784819.951547:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784819.951554:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9e20f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.951562:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784819.951567:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9e20f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.951587:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9e20f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.951598:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9e20f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.951607:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d65b62/0x88ace7295d9e20f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.951620:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784819.951622:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784819.951624:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787784819.951964:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787784819.951970:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e216 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.951979:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1787784819.951982:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784819.951986:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.951995:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.952004:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.952023:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e216 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.952037:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784819.952061:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784819.952067:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e216 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.952075:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784819.952079:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e216 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.952087:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e216 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.952097:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e216 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784819.952105:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784819.952106:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784819.952108:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784819.952447:0:18614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038cd5f83/0x88ace7295d9e216 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787784819.953174:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787784819.953182:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e21d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.953194:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1787784819.953200:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784819.953206:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e21d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.953218:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e21d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.953227:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e21d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.953235:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e21d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784819.953269:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787784819.953307:0:18614:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1787784819.953457:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17132:x1874627750200576:12345-0@lo:5:osp-pre-0-0.0 Request processed in 93616us (93758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784819.953470:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1787784819.953566:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784819.953573:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e21d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.953580:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784819.953585:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e21d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.953595:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e21d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.953610:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e21d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.953628:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005646d944/0x88ace7295d9e21d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784819.953645:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784819.953647:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784819.953649:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784819.953814:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17132:1874627750200576:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787784819.953836:0:17132:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1787784819.953897:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17132:1874627750200704:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787784819.953959:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784819.953992:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f0295780 going to sleep for 11 seconds 00000100:00100000:2.0:1787784819.954850:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750200704 00000100:00100000:2.0:1787784819.954863:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750200704 00000100:00100000:2.0:1787784819.954929:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784819.954941:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17132:x1874627750200704:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787784819.955010:0:18612:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:1.0:1787784819.964000:0:18609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1787784819.964070:0:18609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787784819.964553:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17132:x1874627750200704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9607us (10586us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787784819.964560:0:17132:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1787784819.964567:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784819.964570:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17132:1874627750200704:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787784819.964590:0:17132:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000040:00080000:1.0:1787784820.554038:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784820.814643:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784821.835441:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784822.857275:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784823.880416:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784823.942034:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750200832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784823.942138:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784823.942375:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750200832 00000100:00100000:3.0:1787784823.942384:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750200832 00000100:00100000:3.0:1787784823.942448:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784823.942457:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750200832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784823.942489:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787784823.942539:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750200832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784823.942547:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787784823.942751:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784823.942817:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750200832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784824.454095:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784824.454120:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750200960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784824.454191:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784824.454282:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750200960 00000100:00100000:0.0:1787784824.454290:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750200960 00000100:00100000:0.0:1787784824.454334:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787784824.454355:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750200960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784824.454388:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787784824.454442:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750200960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784824.454449:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787784824.454513:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750200960:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787784824.906682:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784824.965895:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784824.965918:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750201088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784824.965984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784824.966058:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750201088 00000100:00100000:3.0:1787784824.966065:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750201088 00000100:00100000:3.0:1787784824.966112:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787784824.966121:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750201088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787784824.966153:0:17623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787784824.966201:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750201088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784824.966220:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787784824.966268:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750201088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784824.966917:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784824.966929:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750201216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784824.966969:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784824.967058:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750201216 00000100:00100000:2.0:1787784824.967064:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750201216 00000100:00100000:2.0:1787784824.967113:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784824.967122:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750201216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784824.967137:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784824.967174:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750201216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784824.967181:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787784824.967286:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784824.967314:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750201216:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787784824.967490:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784824.967494:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787784824.967498:0:38:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784824.967503:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 560 00000100:00080000:3.0:1787784824.967507:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787784824.967512:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8951c3238800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784824.967534:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c36cb0c0 x1874627750201472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784824.967568:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784824.967571:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787784824.967573:0:38:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784824.967576:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 560 00000100:00080000:3.0:1787784824.967579:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787784824.967582:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8951cfe44000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784824.967601:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c36c83c0 x1874627750201984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784824.967637:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750201600:0@lo:400:kworker.0 00000100:00100000:3.0:1787784824.967670:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784824.967688:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750202240:0@lo:400:kworker.0 00000100:00100000:3.0:1787784824.967711:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784824.967729:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787784824.967734:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750201344:0@lo:400:kworker.0 00000100:00100000:3.0:1787784824.967760:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784824.967805:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750202112:0@lo:400:kworker.0 00000100:00100000:3.0:1787784824.967826:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784824.967852:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750201600 00000100:00100000:3.0:1787784824.967856:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750201600 00000100:00100000:3.0:1787784824.967883:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750202240 00000100:00100000:3.0:1787784824.967886:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750202240 00000100:00100000:3.0:1787784824.967903:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750202112 00000100:00100000:3.0:1787784824.967905:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750202112 00000100:00100000:3.0:1787784824.967917:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784824.967923:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750201600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784824.967960:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750201600:12345-0@lo:400:kworker.0 Request processed in 37us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784824.967967:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784824.967981:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787784824.967986:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750202240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784824.968023:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750202240:12345-0@lo:400:kworker.0 Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784824.968038:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787784824.968054:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787784824.968059:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750202112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784824.968088:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750202112:12345-0@lo:400:kworker.0 Request processed in 29us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784824.968093:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787784824.968117:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750201856:0@lo:400:kworker.0 00000100:00100000:3.0:1787784824.968142:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784824.968159:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787784824.968163:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750201728:0@lo:400:kworker.0 00000100:00100000:3.0:1787784824.968184:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784824.968199:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750202368:0@lo:400:kworker.0 00000100:00100000:1.0:1787784824.968341:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750201344 00000100:00100000:1.0:1787784824.968345:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750201344 00000100:00100000:1.0:1787784824.968466:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787784824.968473:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3645:x1874627750201344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784824.968504:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3645:x1874627750201344:12345-0@lo:400:kworker.0 Request processed in 33us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784824.968510:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1787784824.968538:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784824.969328:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784824.969371:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750201728 00000100:00100000:3.0:1787784824.969376:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750201728 00000100:00100000:3.0:1787784824.969405:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787784824.969413:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750201728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784824.969455:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750201728:12345-0@lo:400:kworker.0 Request processed in 43us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784824.969461:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787784824.969496:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750201344:0@lo:400:kworker.0 00010000:00080000:3.0:1787784824.969508:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c36c9e00 x1874627750202112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784824.969515:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750202112:0@lo:400:kworker.0 00010000:00080000:3.0:1787784824.969529:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c36ca1c0 x1874627750201600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784824.969535:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750201600:0@lo:400:kworker.0 00010000:00080000:3.0:1787784824.969540:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c36c8780 x1874627750202240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784824.969545:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750202240:0@lo:400:kworker.0 00000100:00100000:3.0:1787784824.969565:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750201728:0@lo:400:kworker.0 00000100:00100000:1.0:1787784824.969630:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750202368 00000100:00100000:1.0:1787784824.969633:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750202368 00000100:00100000:1.0:1787784824.969662:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787784824.969668:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750202368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784824.969705:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750202368:12345-0@lo:400:kworker.0 Request processed in 37us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784824.969711:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787784824.969736:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c36c9a40 x1874627750202368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784824.969742:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750202368:0@lo:400:kworker.0 00000100:00080000:3.0:1787784824.969825:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784824.970129:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750201472:0@lo:8:kworker.0 00000100:00100000:2.0:1787784824.970171:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784824.970207:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750201984:0@lo:8:kworker.0 00000100:00100000:2.0:1787784824.970228:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784824.970260:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750201856 00000100:00100000:2.0:1787784824.970264:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750201856 00000100:00100000:2.0:1787784824.970291:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750201472 00000100:00100000:2.0:1787784824.970294:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750201472 00000100:00100000:1.0:1787784824.970296:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750201984 00000100:00100000:1.0:1787784824.970299:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750201984 00000100:00100000:2.0:1787784824.970306:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784824.970312:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750201856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784824.970314:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787784824.970318:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750201472:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787784824.970337:0:18614:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787784824.970360:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750201856:12345-0@lo:400:kworker.0 Request processed in 49us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784824.970366:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784824.970380:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784824.970383:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750201472:12345-0@lo:8:kworker.0 Request processed in 64us (211us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787784824.970384:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1874627750201984:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787784824.970389:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00020000:2.0:1787784824.970393:0:18613:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1787784824.970412:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1787784824.970414:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1874627750201984:12345-0@lo:8:kworker.0 Request processed in 29us (184us total) trans 0 rc -19/-19 00000100:00080000:1.0:1787784824.970416:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787784824.970419:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750201472:0@lo:8:kworker.0 00000100:00100000:2.0:1787784824.970420:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787784824.970426:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784824.970430:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787784824.970433:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750201984:0@lo:8:kworker.0 00000100:00100000:1.0:1787784824.970457:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750201856:0@lo:400:kworker.0 00000020:01000004:0.0:1787784825.504358:0:19428:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787784825.504376:0:19428:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787784825.504378:0:19428:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787784825.504502:0:19428:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8951c7764000 00000020:01000004:0.0:1787784825.504518:0:19428:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787784825.504534:0:19428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787784825.504547:0:19428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8951fd7bb370) 00000020:00000080:0.0:1787784825.504564:0:19428:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787784825.601714:0:19428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787784825.608661:0:19428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787784825.608988:0:19428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787784825.609230:0:19428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787784825.609542:0:19428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787784825.610042:0:19428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787784825.610274:0:19428:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1787784825.614033:0:19428:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787784825.614243:0:19428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787784825.614263:0:19428:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787784825.614275:0:19428:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x88ace7295d9e22b 00000020:01000004:1.0:1787784825.614285:0:19428:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787784825.614305:0:19428:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787784825.614309:0:19428:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787784825.614315:0:19428:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787784825.614408:0:19428:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787784825.614413:0:19428:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787784825.632823:0:19428:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787784825.632861:0:19428:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.141@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787784825.632866:0:19428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787784825.632868:0:19428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784825.632869:0:19428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784825.632870:0:19428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784825.632872:0:19428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784825.632873:0:19428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784825.632874:0:19428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784825.632876:0:19428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784825.632878:0:19428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784825.632881:0:19428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787784825.632883:0:19428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784825.632889:0:19428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784825.632890:0:19428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784825.632891:0:19428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784825.632892:0:19428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784825.632893:0:19428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784825.632894:0:19428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784825.632895:0:19428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784825.632895:0:19428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784825.632941:0:19428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787784825.632962:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750202496:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787784825.633041:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.633073:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e120dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784825.633187:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750202496 00000100:00100000:3.0:1787784825.633201:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750202496 00000100:00100000:3.0:1787784825.633242:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787784825.633250:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:19428:x1874627750202496:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787784825.633281:0:17100:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787784825.633283:0:17100:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787784825.633287:0:17100:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787784825.633613:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:19428:x1874627750202496:12345-0@lo:253:mount.lustre.0 Request processed in 363us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784825.633620:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787784825.634302:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750202496:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787784825.634311:0:19428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787784825.634313:0:19428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784825.634314:0:19428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784825.634315:0:19428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784825.634316:0:19428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784825.634316:0:19428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784825.634317:0:19428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784825.634318:0:19428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784825.634319:0:19428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784825.634320:0:19428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787784825.634340:0:19428:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8951c7764000 from lustre-OST0001 10000000:01000000:2.0:1787784825.634375:0:19428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787784825.634377:0:19428:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787784825.634385:0:19428:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8951cfef4d28 local copy 00010000:00010000:2.0:1787784825.634395:0:19428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784825.634524:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750202624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784825.634556:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.634631:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2e7acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784825.634725:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750202624 00000100:00100000:3.0:1787784825.634730:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750202624 00000100:00100000:1.0:1787784825.637113:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787784825.637133:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:19428:x1874627750202624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784825.637495:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:19428:x1874627750202624:12345-0@lo:501:mount.lustre.0 Request processed in 372us (2937us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787784825.637501:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787784825.637593:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750202624:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787784825.637630:0:19428:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787784825.637667:0:19428:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787784825.637676:0:19428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.637686:0:19428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784825.637716:0:19428:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8951c7764000 10000000:01000000:2.0:1787784825.637720:0:19428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787784825.637724:0:19428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787784825.637726:0:19428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784825.637729:0:19428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787784825.637731:0:19428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787784825.637754:0:19428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.637760:0:19428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.637788:0:19428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784825.637802:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750202752:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784825.637828:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.637860:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2e7acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784825.637915:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750202752 00000100:00100000:3.0:1787784825.637922:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750202752 00000100:00100000:3.0:1787784825.637958:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787784825.637966:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:19428:x1874627750202752:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784825.637974:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784825.637993:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3713600/0x88ace7295d9e239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e232 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784825.638025:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3713600/0x88ace7295d9e239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e232 expref: 22 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784825.638033:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3713600/0x88ace7295d9e239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e232 expref: 22 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784825.638039:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713600, rc 0) 00000100:00100000:3.0:1787784825.638069:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:19428:x1874627750202752:12345-0@lo:101:mount.lustre.0 Request processed in 105us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784825.638073:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787784825.638219:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750202752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784825.638228:0:19428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.638240:0:19428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784825.639344:0:19428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787784825.640062:0:19428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784825.641818:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787784825.641861:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787784825.641877:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787784825.641892:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787784825.641905:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787784825.641919:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787784825.641940:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787784825.641945:0:19428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787784825.642048:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750202880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784825.642285:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.642382:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2e7a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784825.646063:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750202880 00000100:00100000:3.0:1787784825.646078:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750202880 00000100:00100000:3.0:1787784825.646153:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787784825.646164:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:19428:x1874627750202880:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784825.646383:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:19428:x1874627750202880:12345-0@lo:501:mount.lustre.0 Request processed in 221us (4097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784825.646391:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787784825.646457:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750202880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784825.646509:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784825.646730:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.646765:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2e7a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784825.647545:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750203008 00000100:00100000:0.0:1787784825.647554:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750203008 00000100:00100000:0.0:1787784825.647817:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787784825.647827:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:19428:x1874627750203008:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784825.648959:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:19428:x1874627750203008:12345-0@lo:503:mount.lustre.0 Request processed in 1129us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784825.648970:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787784825.649069:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203008:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787784825.649518:0:19428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784825.649604:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784825.649663:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.650529:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e120dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784825.650678:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750203136 00000100:00100000:1.0:1787784825.650685:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750203136 00000100:00100000:1.0:1787784825.650722:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787784825.650731:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:19428:x1874627750203136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784825.651288:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:19428:x1874627750203136:12345-0@lo:502:mount.lustre.0 Request processed in 556us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.651306:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787784825.651458:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784825.651712:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787784825.651742:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787784825.651757:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787784825.651798:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787784825.651813:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787784825.651826:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787784825.651837:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787784825.651849:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787784825.651860:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787784825.651890:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784825.651931:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.651954:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2e7acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784825.652287:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750203264 00000100:00100000:1.0:1787784825.652292:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750203264 00000100:00100000:1.0:1787784825.652322:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787784825.652330:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:19428:x1874627750203264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784825.652423:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:19428:x1874627750203264:12345-0@lo:502:mount.lustre.0 Request processed in 92us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.652429:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787784825.652931:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784825.652983:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787784825.653006:0:19428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787784825.653905:0:19432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787784825.653913:0:19432:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787784825.653919:0:19432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784825.653922:0:19432:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787784825.653928:0:19432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784825.653942:0:19432:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8951ebd519b8) 00000020:00000080:1.0:1787784825.653965:0:19432:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787784825.653971:0:19432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787784825.654041:0:19432:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951c7764000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787784825.654051:0:19432:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787784825.654057:0:19432:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x88ace7295d9e247 00010000:00010000:1.0:1787784825.659380:0:19432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787784825.659943:0:19432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1787784825.664313:0:19432:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787784825.666031:0:19432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787784825.666047:0:19432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784825.666053:0:19432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784825.666055:0:19432:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787784825.666058:0:19432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784825.666063:0:19432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784825.666064:0:19432:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787784825.666073:0:19432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787784825.666146:0:19432:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787784825.666152:0:19432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784825.666155:0:19432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784825.666156:0:19432:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787784825.666159:0:19432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784825.666161:0:19432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784825.666163:0:19432:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787784825.666166:0:19432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787784825.666192:0:19432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784825.666195:0:19432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784825.666196:0:19432:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787784825.666265:0:19432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787784825.670461:0:19428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787784825.670511:0:19428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787784825.670530:0:19428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.670542:0:19428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784825.670585:0:19428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951c7764000 from 1 10000000:01000000:2.0:1787784825.670588:0:19428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784825.670626:0:19428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.670634:0:19428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.670666:0:19428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784825.670695:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784825.670786:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.670823:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c8bd0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784825.682887:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750203392 00000100:00100000:1.0:1787784825.682903:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750203392 00000100:00100000:1.0:1787784825.682956:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787784825.682966:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:19428:x1874627750203392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784825.682983:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784825.683013:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df603600/0x88ace7295d9e255 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e24e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784825.683042:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603600/0x88ace7295d9e255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e24e expref: 23 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784825.683054:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df603600/0x88ace7295d9e255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e24e expref: 23 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784825.683063:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603600, rc 0) 00000100:00100000:1.0:1787784825.683753:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:19428:x1874627750203392:12345-0@lo:101:mount.lustre.0 Request processed in 787us (12982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.683762:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787784825.685978:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784825.686014:0:19428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e255 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.686027:0:19428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e255 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784825.687420:0:19428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787784825.687895:0:19428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784825.688093:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787784825.688119:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787784825.688139:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787784825.688145:0:19428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787784825.688504:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784825.688571:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.688669:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c8bd0600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784825.700833:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750203520 00000100:00100000:1.0:1787784825.700846:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750203520 00000100:00100000:1.0:1787784825.700904:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787784825.700914:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:19428:x1874627750203520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784825.701108:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:19428:x1874627750203520:12345-0@lo:501:mount.lustre.0 Request processed in 196us (12537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.701116:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787784825.701453:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784825.701507:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784825.701561:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784825.701599:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784825.701660:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750203648 00000100:00100000:0.0:1787784825.701665:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750203648 00000100:00100000:0.0:1787784825.701703:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787784825.701710:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:19428:x1874627750203648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784825.701822:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:19428:x1874627750203648:12345-0@lo:503:mount.lustre.0 Request processed in 112us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784825.701830:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787784825.702055:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203648:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787784825.703939:0:19428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784825.704030:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784825.704749:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784825.704852:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784825.708482:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750203776 00000100:00100000:2.0:1787784825.708497:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750203776 00000100:00100000:2.0:1787784825.708560:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787784825.708570:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:19428:x1874627750203776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784825.724068:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:19428:x1874627750203776:12345-0@lo:502:mount.lustre.0 Request processed in 15489us (19310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784825.724096:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787784825.724236:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784825.724513:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787784825.724547:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787784825.724581:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787784825.724596:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787784825.724608:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787784825.724620:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787784825.724632:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787784825.724645:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787784825.724675:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787784825.724690:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787784825.724703:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787784825.724740:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784825.724819:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784825.724858:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784825.725010:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750203904 00000100:00100000:2.0:1787784825.725023:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750203904 00000100:00100000:2.0:1787784825.725060:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787784825.725070:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:19428:x1874627750203904:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784825.725179:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:19428:x1874627750203904:12345-0@lo:502:mount.lustre.0 Request processed in 111us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784825.725186:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787784825.725375:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750203904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784825.725605:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787784825.725616:0:19428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787784825.727387:0:19436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784825.727399:0:19436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784825.727401:0:19436:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787784825.727408:0:19436:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951c7764000 00000020:00000080:3.0:1787784825.727411:0:19436:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784825.727419:0:19436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784825.727422:0:19436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784825.727423:0:19436:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787784825.727426:0:19436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784825.727439:0:19436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784825.727441:0:19436:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787784825.727445:0:19436:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951c7764000 00000020:00000080:3.0:1787784825.727447:0:19436:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784825.727508:0:19436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784825.727512:0:19436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784825.727513:0:19436:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787784825.727515:0:19436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784825.727518:0:19436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784825.727519:0:19436:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787784825.727523:0:19436:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951c7764000 00000020:00000080:3.0:1787784825.727525:0:19436:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784825.727543:0:19436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784825.727546:0:19436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784825.727547:0:19436:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787784825.727549:0:19436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784825.727552:0:19436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784825.727553:0:19436:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787784825.727556:0:19436:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951c7764000 00000020:00000080:3.0:1787784825.727558:0:19436:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784825.727577:0:19436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784825.727581:0:19436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784825.727582:0:19436:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787784825.727585:0:19436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1787784825.727756:0:19428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787784825.727808:0:19428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784825.727831:0:19428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e255 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.727843:0:19428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e255 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784825.727895:0:19428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787784825.727898:0:19428:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8951c7764000 10000000:01000000:2.0:1787784825.727900:0:19428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8951c7764000 10000000:01000000:2.0:1787784825.727905:0:19428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784825.727910:0:19428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951c7764000 from 1 10000000:01000000:2.0:1787784825.727913:0:19428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787784825.727947:0:19428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.727955:0:19428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.727965:0:19428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784825.727987:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750204032:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784825.728065:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.728109:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c8bd0600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784825.740699:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750204032 00000100:00100000:1.0:1787784825.740711:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750204032 00000100:00100000:1.0:1787784825.740760:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787784825.740783:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:19428:x1874627750204032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784825.740799:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784825.740816:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df603200/0x88ace7295d9e263 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e25c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784825.740843:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603200/0x88ace7295d9e263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e25c expref: 24 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784825.740854:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df603200/0x88ace7295d9e263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e25c expref: 24 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784825.740864:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603200, rc 0) 00000100:00100000:1.0:1787784825.740944:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:19428:x1874627750204032:12345-0@lo:101:mount.lustre.0 Request processed in 175us (12878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.740951:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787784825.741018:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750204032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784825.741036:0:19428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784825.741061:0:19428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787784825.748487:0:19428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1787784825.748831:0:19428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784825.749267:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787784825.749293:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787784825.749306:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787784825.749317:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787784825.749505:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787784825.749525:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787784825.749539:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787784825.749552:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787784825.749564:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787784825.749576:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787784825.749589:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787784825.749600:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787784825.749611:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787784825.749624:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787784825.749661:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787784825.749678:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787784825.749689:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787784825.749701:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787784825.749713:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787784825.749726:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787784825.749738:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787784825.749749:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787784825.749762:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787784825.749803:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787784825.749818:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787784825.749830:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787784825.751032:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787784825.751046:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787784825.751057:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787784825.751068:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787784825.751091:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787784825.751103:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787784825.751442:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787784825.751458:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787784825.751469:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787784825.751480:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787784825.751490:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787784825.751501:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787784825.751512:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1787784825.751522:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1787784825.751532:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1787784825.751543:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1787784825.751553:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1787784825.751563:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1787784825.751574:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1787784825.751584:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1787784825.751615:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1787784825.751620:0:19428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1787784825.751750:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750204160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784825.751845:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784825.751899:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2e7a300 going to sleep for 11 seconds 00000100:00100000:0.0:1787784825.759455:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750204160 00000100:00100000:0.0:1787784825.759468:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750204160 00000100:00100000:0.0:1787784825.759536:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787784825.759547:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:19428:x1874627750204160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784825.759744:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:19428:x1874627750204160:12345-0@lo:501:mount.lustre.0 Request processed in 198us (7898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784825.759752:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787784825.764613:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750204160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784825.764678:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750204288:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784825.764761:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784825.764818:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750204288 00000100:00100000:3.0:1787784825.764819:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784825.764826:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750204288 00000100:00100000:1.0:1787784825.764899:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787784825.764909:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:19428:x1874627750204288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784825.765026:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:19428:x1874627750204288:12345-0@lo:503:mount.lustre.0 Request processed in 118us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.765043:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787784825.767278:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750204288:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787784825.767754:0:19428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784825.767870:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750204416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784825.767935:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784825.767972:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784825.767980:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750204416 00000100:00100000:1.0:1787784825.767987:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750204416 00000100:00100000:1.0:1787784825.768046:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787784825.768055:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:19428:x1874627750204416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784825.768242:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:19428:x1874627750204416:12345-0@lo:502:mount.lustre.0 Request processed in 187us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.768250:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787784825.768275:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750204416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784825.768434:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787784825.768457:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787784825.768484:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787784825.768499:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787784825.768512:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787784825.768524:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787784825.768537:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787784825.768549:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787784825.768561:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787784825.768573:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787784825.768587:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787784825.768601:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787784825.768614:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787784825.768628:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787784825.768642:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787784825.768656:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787784825.768670:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787784825.768681:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787784825.768703:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787784825.768718:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787784825.768732:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787784825.768744:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787784825.768757:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787784825.768792:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787784825.768809:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1787784825.768824:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1787784825.768837:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1787784825.768861:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1787784825.768874:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1787784825.768887:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1787784825.768898:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1787784825.768909:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1787784825.768922:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1787784825.768935:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1787784825.768958:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1787784825.768975:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1787784825.768989:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1787784825.769017:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1787784825.769032:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1787784825.769045:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1787784825.769057:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1787784825.769070:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1787784825.769609:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1787784825.769627:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1787784825.769641:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1787784825.769655:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1787784825.769669:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1787784825.769681:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1787784825.769720:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750204544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784825.769806:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784825.769838:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784825.769984:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750204544 00000100:00100000:1.0:1787784825.769990:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750204544 00000100:00100000:1.0:1787784825.770083:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787784825.770094:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:19428:x1874627750204544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784825.770214:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:19428:x1874627750204544:12345-0@lo:502:mount.lustre.0 Request processed in 122us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.770222:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787784825.771242:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750204544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784825.771456:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787784825.771481:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787784825.771511:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750204672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784825.771563:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.781168:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c8bd0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787784825.782784:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750204672 00000100:00100000:3.0:1787784825.782799:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750204672 00000100:00100000:3.0:1787784825.782984:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787784825.783003:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:19428:x1874627750204672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784825.783192:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:19428:x1874627750204672:12345-0@lo:502:mount.lustre.0 Request processed in 200us (11628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784825.783201:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787784825.784632:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750204672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784825.784736:0:19428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787784825.784751:0:19428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787784825.786747:0:19441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787784825.786819:0:19441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8951f02d99b8) 00000020:00000080:2.0:1787784825.786967:0:19441:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1787784825.787061:0:19441:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951c7764000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787784825.787066:0:19441:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951c7764000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787784825.787069:0:19441:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951c7764000 3 00010000:00080000:2.0:1787784825.787100:0:19441:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c360c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1787784825.793973:0:19441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1787784825.794178:0:19441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787784825.794223:0:19441:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787784825.794236:0:19441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x88ace7295d9e271 00000100:00080000:2.0:1787784825.794246:0:19441:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784825.794252:0:19441:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8950c360c000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784825.794285:0:19441:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c43b21c0 x1874627750204800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784825.794306:0:19441:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787784825.794390:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784825.794395:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787784825.794398:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784825.794403:0:15021:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 565 00000100:00080000:2.0:1787784825.794406:0:15021:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787784825.794410:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8951c3238800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784825.794434:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c43b0000 x1874627750205184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784825.794462:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784825.794465:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787784825.794467:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784825.794470:0:15021:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 565 00000100:00080000:2.0:1787784825.794472:0:15021:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787784825.794476:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8951cfe44000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784825.794485:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c4167c00 x1874627750205696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784825.795167:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750204800:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784825.795240:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784825.795282:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750205184:0@lo:8:kworker.0 00000100:00100000:1.0:1787784825.795308:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784825.795323:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750205312:0@lo:400:kworker.0 00000100:00100000:1.0:1787784825.795324:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4167c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750205696:0@lo:8:kworker.0 00000100:00100000:1.0:1787784825.795343:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784825.795348:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784825.795366:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4164f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750205952:0@lo:400:kworker.0 00000100:00100000:1.0:1787784825.795375:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750204928:0@lo:400:kworker.0 00000100:00100000:3.0:1787784825.795383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784825.795397:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784825.795400:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787784825.795406:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750205056:0@lo:400:kworker.0 00000100:00100000:1.0:1787784825.795412:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4167840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750205568:0@lo:400:kworker.0 00000100:00100000:3.0:1787784825.795424:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784825.795439:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4166580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750205824:0@lo:400:kworker.0 00000100:00100000:1.0:1787784825.795440:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784825.795455:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787784825.795456:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784825.795461:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c41643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750205440:0@lo:400:kworker.0 00000100:00100000:1.0:1787784825.795480:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784825.795498:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c41652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750206080:0@lo:400:kworker.0 00000100:00100000:1.0:1787784825.795515:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784825.795551:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750204800 00000100:00100000:1.0:1787784825.795555:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750205312 00000100:00100000:3.0:1787784825.795558:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750204800 00000100:00100000:1.0:1787784825.795558:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750205312 00000100:00100000:3.0:1787784825.795582:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750205824 00000100:00100000:1.0:1787784825.795582:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750205952 00000100:00100000:3.0:1787784825.795585:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750205824 00000100:00100000:1.0:1787784825.795585:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750205952 00000100:00100000:1.0:1787784825.795595:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750206080 00000100:00100000:1.0:1787784825.795597:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750206080 00000100:00100000:3.0:1787784825.795599:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787784825.795607:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750205312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784825.795608:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784825.795612:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874627750204800:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787784825.795631:0:17108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 566 last 0 00000100:00100000:3.0:1787784825.795654:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750205312:12345-0@lo:400:kworker.0 Request processed in 48us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784825.795661:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00000080:1.0:1787784825.795672:0:17108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x88ace7295d9e278 00000100:00100000:3.0:1787784825.795675:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787784825.795680:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750205952:12345-0@lo:400:kworker.0 00000004:00100000:1.0:1787784825.795688:0:17108:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1787784825.795704:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750205952:12345-0@lo:400:kworker.0 Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784825.795709:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787784825.795714:0:17108:0:(import.c:65:import_set_state_nolock()) ffff8950c2645000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784825.795719:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787784825.795723:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750205824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784825.795742:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750205824:12345-0@lo:400:kworker.0 Request processed in 19us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.795746:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874627750204800:12345-0@lo:38:llog_process_th.0 Request processed in 133us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.795752:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784825.795755:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787784825.795764:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784825.795785:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750206080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784825.795817:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750206080:12345-0@lo:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.796429:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750205184 00000100:00100000:1.0:1787784825.796435:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750205184 00000100:00100000:1.0:1787784825.796449:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750205696 00000100:00100000:1.0:1787784825.796451:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750205696 00000100:00100000:1.0:1787784825.796458:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750205056 00000100:00100000:1.0:1787784825.796460:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750205056 00000100:00100000:1.0:1787784825.796474:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750205568 00000100:00100000:1.0:1787784825.796477:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750205568 00000100:00100000:1.0:1787784825.796511:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784825.796517:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750205056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784825.796553:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750205056:12345-0@lo:400:kworker.0 Request processed in 36us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.796559:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784825.796571:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784825.796577:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750205568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784825.796599:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750205568:12345-0@lo:400:kworker.0 Request processed in 23us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.796605:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784825.796614:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784825.796618:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750205184:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787784825.796791:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750205184:12345-0@lo:8:kworker.0 Request processed in 29us (1339us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787784825.796799:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784825.796810:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784825.796815:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750205696:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787784825.796949:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750205696:12345-0@lo:8:kworker.0 Request processed in 132us (1603us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787784825.796955:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784825.796978:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750204928 00000100:00100000:1.0:1787784825.796981:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750204928 00000100:00100000:1.0:1787784825.797016:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750205440 00000100:00100000:1.0:1787784825.797019:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750205440 00000100:00100000:1.0:1787784825.797032:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787784825.797037:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750204928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784825.797069:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750204928:12345-0@lo:400:kworker.0 Request processed in 32us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.797082:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787784825.797095:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787784825.797100:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750205440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784825.797129:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750205440:12345-0@lo:400:kworker.0 Request processed in 29us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784825.797134:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787784825.797157:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787784825.797188:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c43b21c0 x1874627750204800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784825.797198:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784825.797206:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787784825.797213:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787784825.797217:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787784825.797220:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c360c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787784825.797226:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750204800:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784825.797238:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784825.797241:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784825.797245:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787784825.797248:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750205184:0@lo:8:kworker.0 00000100:00100000:1.0:1787784825.797256:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784825.797259:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784825.797261:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787784825.797264:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4167c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750205696:0@lo:8:kworker.0 00000100:00100000:3.0:1787784825.798421:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784825.798480:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750205056:0@lo:400:kworker.0 00010000:00080000:3.0:1787784825.798496:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c4166580 x1874627750205824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784825.798505:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4166580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750205824:0@lo:400:kworker.0 00010000:00080000:3.0:1787784825.798515:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c43b1e00 x1874627750205312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784825.798521:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750205312:0@lo:400:kworker.0 00010000:00080000:3.0:1787784825.798531:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c4164f00 x1874627750205952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784825.798537:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4164f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750205952:0@lo:400:kworker.0 00000100:00100000:3.0:1787784825.798574:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c41643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750205440:0@lo:400:kworker.0 00010000:00080000:3.0:1787784825.798586:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c41652c0 x1874627750206080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784825.798593:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c41652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750206080:0@lo:400:kworker.0 00000100:00100000:3.0:1787784825.798602:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750204928:0@lo:400:kworker.0 00000100:00100000:3.0:1787784825.798622:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4167840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750205568:0@lo:400:kworker.0 00000020:01000004:2.0:1787784825.800252:0:19441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787784825.800268:0:19441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8951f02d8000) 00000020:00000080:2.0:1787784825.800292:0:19441:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787784825.801520:0:19441:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951c7764000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787784825.801526:0:19441:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951c7764000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787784825.801529:0:19441:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951c7764000 3 00010000:00080000:2.0:1787784825.801562:0:19441:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c360b800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1787784825.806171:0:19441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1787784825.807474:0:19441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787784825.807522:0:19441:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787784825.807549:0:19441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x88ace7295d9e286 00000100:00080000:2.0:1787784825.807562:0:19441:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784825.807568:0:19441:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8950c360b800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784825.807607:0:19441:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c4166940 x1874627750206208/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784825.807640:0:19441:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787784825.808042:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4166940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874627750206208:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784825.808398:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.808721:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750206208 00000100:00100000:2.0:1787784825.808729:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750206208 00000100:00100000:2.0:1787784825.808762:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784825.808794:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874627750206208:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787784825.808822:0:17108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:2.0:1787784825.809011:0:17108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x88ace7295d9e28d 00000004:00100000:2.0:1787784825.809026:0:17108:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787784825.809058:0:17108:0:(import.c:65:import_set_state_nolock()) ffff8951c41db800 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1787784825.809216:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c4166940 x1874627750206208/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784825.809226:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784825.809233:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787784825.809239:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787784825.809243:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787784825.809245:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c360b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787784825.809251:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4166940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874627750206208:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787784825.810724:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874627750206208:12345-0@lo:38:llog_process_th.0 Request processed in 1922us (2391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784825.810739:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:2.0:1787784825.816600:0:19441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1787784825.816663:0:19428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787784825.816693:0:19428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787784825.826148:0:19428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.826167:0:19428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787784825.826262:0:19428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787784825.826265:0:19428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784825.826270:0:19428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784825.826271:0:19428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784825.826272:0:19428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784825.826274:0:19428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784825.826275:0:19428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784825.826276:0:19428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784825.826278:0:19428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784825.826283:0:19428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787784825.826285:0:19428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784825.826286:0:19428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784825.826287:0:19428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784825.826288:0:19428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784825.826289:0:19428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784825.826289:0:19428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784825.826290:0:19428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784825.826291:0:19428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784825.826292:0:19428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784825.826317:0:19428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787784825.826338:0:19428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4164000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750206336:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787784825.826409:0:19428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.826452:0:19428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f0295c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784825.826546:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750206336 00000100:00100000:3.0:1787784825.826555:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750206336 00000100:00100000:3.0:1787784825.826603:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787784825.826612:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:19428:x1874627750206336:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787784825.826637:0:17100:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787784825.826649:0:17100:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787784825.842966:0:17100:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787784825.842987:0:17100:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787784825.843498:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:19428:x1874627750206336:12345-0@lo:253:mount.lustre.0 Request processed in 16881us (17084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784825.843511:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787784825.843607:0:19428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4164000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a45ddeb3-718a-48eb-8507-e0c94319fca6:19428:1874627750206336:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787784825.843619:0:19428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787784825.843622:0:19428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787784825.843624:0:19428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787784825.843625:0:19428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784825.843626:0:19428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784825.843627:0:19428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784825.843629:0:19428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784825.843630:0:19428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787784825.843631:0:19428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784825.843632:0:19428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787784825.843645:0:19428:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787784825.844053:0:17123:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787784825.844058:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787784825.844087:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.844101:0:17123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e13d expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.844110:0:17123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951df602200/0x88ace7295d9e152 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e14b expref: 23 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.844118:0:17123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.844154:0:17123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951df602200/0x88ace7295d9e152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e14b expref: 23 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.844176:0:17123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951df602200/0x88ace7295d9e152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e14b expref: 23 pid: 17100 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784825.844191:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c41661c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750206464:0@lo:104: 00000100:00100000:2.0:1787784825.844405:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787784825.844449:0:17123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e13d expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.844459:0:17123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e13d expref: 23 pid: 17102 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784825.844467:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4164000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750206592:0@lo:104: 00000100:00100000:2.0:1787784825.844487:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.844507:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f02950c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784825.844733:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750206464 00000100:00100000:0.0:1787784825.844740:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750206464 00000100:00100000:0.0:1787784825.844794:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750206592 00000100:00100000:0.0:1787784825.844798:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750206592 00000100:00100000:0.0:1787784825.844815:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784825.844823:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4167480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+4:17123:x1874627750206464:12345-0@lo:104: 00010000:00010000:0.0:1787784825.844835:0:17091:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e152 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784825.844886:0:17091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784825.844892:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4167480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+4:17123:x1874627750206464:12345-0@lo:104: Request processed in 71us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784825.844899:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784825.844913:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784825.844919:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4166940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+3:17123:x1874627750206592:12345-0@lo:104: 00010000:00010000:0.0:1787784825.844926:0:17091:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e144 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784825.844959:0:17091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787784825.844965:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4166940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+3:17123:x1874627750206592:12345-0@lo:104: Request processed in 46us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784825.844977:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787784825.845002:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784825.845008:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e152 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784825.845015:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784825.845019:0:17095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e152 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784825.845027:0:17095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e152 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784825.845034:0:17095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e152 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784825.845039:0:17095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784825.845067:0:17095:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e152 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784825.845345:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c41661c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750206464:0@lo:104: 00000100:00100000:2.0:1787784825.845353:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4164000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17123:1874627750206592:0@lo:104: 00010000:00010000:2.0:1787784825.845371:0:17123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784825.846281:0:17095:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784825.846301:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784825.846317:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e152 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784825.846320:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1787784825.846327:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9e14b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e152 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784825.846341:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784825.846343:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784825.846344:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750206720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784825.846345:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784825.846393:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784825.847414:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750206720 00000100:00100000:0.0:1787784825.847428:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750206720 00010000:00010000:0.0:1787784825.847457:0:17092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951df602200/0x88ace7295d9e152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e14b expref: 24 pid: 17100 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784825.847494:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784825.847629:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e12d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3646:x1874627750206720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784825.847697:0:17092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784825.847705:0:17092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951df602200/0x88ace7295d9e152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e14b expref: 24 pid: 17100 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784825.847717:0:17092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951df602200/0x88ace7295d9e152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e14b expref: 24 pid: 17100 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784825.847734:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df602200/0x88ace7295d9e152 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e14b expref: 24 pid: 17100 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784825.847746:0:17092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784825.847813:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e12d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:3646:x1874627750206720:12345-0@lo:103:ldlm_bl.0 Request processed in 311us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784825.847820:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784825.847833:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750206720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784825.848888:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784825.848892:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784825.848894:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784825.848925:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e144 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.848936:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602c00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784825.848940:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e144 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.848949:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e144 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784825.848963:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e144 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784825.848971:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784825.849012:0:17096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e144 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849018:0:17096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784825.849053:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e144 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849059:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951df602c00/0x88ace7295d9e13d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e144 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849083:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784825.849085:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784825.849087:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784825.849128:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750206848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784825.849173:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784825.849417:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750206848 00000100:00100000:2.0:1787784825.849423:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750206848 00010000:00010000:2.0:1787784825.849446:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e13d expref: 23 pid: 17102 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784825.849477:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784825.849486:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:3644:x1874627750206848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784825.849496:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784825.849501:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e13d expref: 23 pid: 17102 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849510:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e13d expref: 23 pid: 17102 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849528:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e144 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e13d expref: 23 pid: 17102 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849540:0:17094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849548:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787784825.849562:0:17094:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005503513s 00010000:00010000:2.0:1787784825.849566:0:17094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849573:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849579:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849585:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849590:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784825.849593:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849601:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849614:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.849635:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784825.850763:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:3644:x1874627750206848:12345-0@lo:103:ldlm_bl.0 Request processed in 1272us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784825.850787:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787784825.850825:0:17123:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.850835:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784825.850842:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c4183400/0x88ace7295d9e294 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784825.850882:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750206848:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1787784825.874331:0:19428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787784825.881459:0:19428:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787784825.881470:0:19428:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787784825.881506:0:19428:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787784825.881556:0:19428:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787784825.881576:0:19428:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1787784825.881604:0:19428:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1787784825.883497:0:19428:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784825.883723:0:19428:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787784825.926877:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787784826.446630:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787784826.959337:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787784827.160946:0:19495:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784827.161364:0:19495:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1787784827.846276:0:17104:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787784827.846282:0:17104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8950c4020000 from 10 10000000:01000000:3.0:1787784827.846286:0:17104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787784827.846330:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784827.846342:0:17104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784827.846353:0:17104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784827.846385:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750206976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784827.846454:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784827.846491:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d2737240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784827.846511:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750206976 00000100:00100000:3.0:1787784827.846517:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750206976 00000100:00100000:3.0:1787784827.846559:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787784827.846568:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:17104:x1874627750206976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784827.846581:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784827.846593:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c3713c00/0x88ace7295d9e2a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e29b expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784827.846615:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c3713c00/0x88ace7295d9e2a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e29b expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784827.846626:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c3713c00/0x88ace7295d9e2a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e29b expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784827.846635:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713c00, rc 0) 00000100:00100000:3.0:1787784827.846671:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:17104:x1874627750206976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784827.846677:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787784827.846724:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750206976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784827.846737:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784827.846746:0:17104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784827.846824:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750207104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787784827.846853:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784827.846871:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d2737240 going to sleep for 11 seconds 00000100:00100000:0.0:1787784827.848321:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750207104 00000100:00100000:0.0:1787784827.848331:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750207104 00000100:00100000:0.0:1787784827.848374:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787784827.848384:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:17104:x1874627750207104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787784827.848410:0:17100:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787784827.848423:0:17100:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787784827.848426:0:17100:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787784827.848522:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:17104:x1874627750207104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784827.848530:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787784827.848567:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750207104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787784827.848630:0:17104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787784827.848639:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784827.848648:0:17104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784827.848658:0:17104:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787784827.848660:0:17104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951fb22c000 from 10 10000000:01000000:0.0:1787784827.848663:0:17104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787784827.848690:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784827.848698:0:17104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784827.848707:0:17104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784827.848725:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750207232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784827.848752:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784827.848804:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c832dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784827.848818:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750207232 00000100:00100000:0.0:1787784827.848821:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750207232 00000100:00100000:0.0:1787784827.848845:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787784827.848851:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:17104:x1874627750207232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784827.848859:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784827.848871:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1628400/0x88ace7295d9e2b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e2a9 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784827.848889:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1628400/0x88ace7295d9e2b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e2a9 expref: 24 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784827.848898:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1628400/0x88ace7295d9e2b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e2a9 expref: 24 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784827.848905:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628400, rc 0) 00000100:00100000:0.0:1787784827.848931:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:17104:x1874627750207232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784827.848938:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787784827.848967:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750207232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784827.848990:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784827.849000:0:17104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784827.849037:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750207360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787784827.849065:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784827.849087:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c832dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784827.849097:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750207360 00000100:00100000:0.0:1787784827.849101:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750207360 00000100:00100000:0.0:1787784827.849120:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787784827.849126:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:17104:x1874627750207360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787784827.849137:0:17101:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787784827.849147:0:17101:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787784827.849150:0:17101:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787784827.849293:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:17104:x1874627750207360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 166us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784827.849300:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787784827.849332:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750207360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787784827.849370:0:17104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787784827.849376:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784827.849382:0:17104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784827.974640:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784828.999928:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784829.064367:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784829.068002:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750207488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784829.068083:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784829.068179:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750207488 00000100:00100000:2.0:1787784829.068188:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750207488 00000100:00100000:2.0:1787784829.068262:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784829.068288:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1fff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750207488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784829.068322:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784829.068377:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1fff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750207488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784829.068384:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784829.068432:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750207488:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787784829.068494:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784829.574956:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750207616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784829.575048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784829.575506:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750207616 00000100:00100000:0.0:1787784829.575515:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750207616 00000100:00100000:0.0:1787784829.575562:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787784829.575580:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750207616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784829.575611:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787784829.575655:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750207616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784829.575672:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787784829.575948:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750207616:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784830.022112:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784830.087048:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750207744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784830.087119:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784830.087175:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750207744 00000100:00100000:3.0:1787784830.087182:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750207744 00000100:00100000:3.0:1787784830.087239:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787784830.087248:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750207744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787784830.087281:0:17623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787784830.087328:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750207744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784830.087335:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787784830.087381:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750207744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784830.089755:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750207872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784830.089907:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784830.089978:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750207872 00000100:00100000:3.0:1787784830.089985:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750207872 00000100:00100000:3.0:1787784830.090040:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784830.090049:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750207872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784830.090068:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787784830.090111:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750207872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784830.090145:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787784830.090167:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784830.090598:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750207872:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787784830.793255:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784831.046685:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787784831.110481:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784831.110488:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787784831.110492:0:38:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784831.110504:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8951c3238800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784831.110525:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c43b30c0 x1874627750208384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784831.110569:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784831.110572:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787784831.110574:0:38:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784831.110578:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8951cfe44000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784831.110588:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8950c3412d00 x1874627750208896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784831.110638:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750208128:0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.110706:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784831.110751:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3411e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750208768:0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.110793:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784831.110811:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750209408:0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.110836:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784831.110861:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787784831.110867:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750208256:0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.110888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784831.110903:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750209024:0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.110921:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784831.110936:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750209536:0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.110967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784831.110995:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750208384:0@lo:8:kworker.0 00000100:00100000:1.0:1787784831.111016:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784831.111033:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750208896:0@lo:8:kworker.0 00000100:00100000:1.0:1787784831.111050:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784831.111089:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750208128 00000100:00100000:1.0:1787784831.111095:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750208128 00000100:00100000:1.0:1787784831.111134:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787784831.111143:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750208128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.111195:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750208128:12345-0@lo:400:kworker.0 Request processed in 53us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784831.111202:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787784831.111224:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750208768 00000100:00100000:1.0:1787784831.111228:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750208768 00000100:00100000:1.0:1787784831.111258:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750208256 00000100:00100000:1.0:1787784831.111261:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750208256 00000100:00100000:1.0:1787784831.111271:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750208384 00000100:00100000:1.0:1787784831.111273:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750208384 00000100:00100000:1.0:1787784831.111281:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750208896 00000100:00100000:1.0:1787784831.111283:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750208896 00000100:00100000:1.0:1787784831.111292:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784831.111298:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750208768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.111330:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750208768:12345-0@lo:400:kworker.0 Request processed in 32us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784831.111336:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784831.111347:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784831.111353:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750208256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.111379:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750208256:12345-0@lo:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784831.111384:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784831.111395:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784831.111399:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2661a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750208384:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787784831.111425:0:18614:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:1.0:1787784831.111456:0:18614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9e2b7 00002000:00100000:1.0:1787784831.111470:0:18614:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8950c2642800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787784831.111475:0:18614:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787784831.111477:0:18614:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787784831.111643:0:18614:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787784831.111665:0:18614:0:(import.c:65:import_set_state_nolock()) ffff8950c2646800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784831.111701:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2661a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1874627750208384:12345-0@lo:8:kworker.0 Request processed in 299us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784831.111707:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784831.111721:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787784831.111725:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2661680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750208896:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787784831.111740:0:18614:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:1.0:1787784831.111756:0:18614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9e2be 00002000:00100000:1.0:1787784831.111762:0:18614:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8950c2640800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787784831.111789:0:18614:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1787784831.111791:0:18614:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787784831.111814:0:18614:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787784831.111826:0:18614:0:(import.c:65:import_set_state_nolock()) ffff8950c2643000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784831.111854:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2661680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1874627750208896:12345-0@lo:8:kworker.0 Request processed in 127us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784831.111860:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787784831.111879:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750209408 00000100:00100000:1.0:1787784831.111883:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750209408 00000100:00100000:1.0:1787784831.111912:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750209024 00000100:00100000:1.0:1787784831.111915:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750209024 00000100:00100000:1.0:1787784831.111925:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750209536 00000100:00100000:1.0:1787784831.111927:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750209536 00000100:00100000:1.0:1787784831.111966:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787784831.111973:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2663840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750209408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.112016:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2663840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750209408:12345-0@lo:400:kworker.0 Request processed in 44us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784831.112022:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787784831.112034:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787784831.112040:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2660780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750209024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.112063:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2660780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750209024:12345-0@lo:400:kworker.0 Request processed in 23us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784831.112068:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787784831.112079:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784831.112085:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2660b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750209536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.112109:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2660b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750209536:12345-0@lo:400:kworker.0 Request processed in 24us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784831.112114:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787784831.112152:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784831.112156:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784831.112158:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787784831.112189:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c43b30c0 x1874627750208384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787784831.112203:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787784831.112210:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787784831.112215:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787784831.112218:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787784831.112233:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787784831.112238:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750208384:0@lo:8:kworker.0 00010000:00080000:1.0:1787784831.112261:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3412d00 x1874627750208896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787784831.112270:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787784831.112275:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787784831.112278:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787784831.112280:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787784831.112288:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787784831.112292:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750208896:0@lo:8:kworker.0 00000004:00080000:1.0:1787784831.112357:0:17134:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1787784831.112373:0:17134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2663480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17134:1874627750209792:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787784831.112400:0:17134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784831.112416:0:17134:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784831.112438:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750208256:0@lo:400:kworker.0 00010000:00080000:1.0:1787784831.112448:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c34121c0 x1874627750209024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784831.112457:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750209024:0@lo:400:kworker.0 00010000:00080000:1.0:1787784831.112466:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3410000 x1874627750209536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784831.112474:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750209536:0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.112484:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750208128:0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.112494:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3411e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750208768:0@lo:400:kworker.0 00010000:00080000:1.0:1787784831.112503:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3412940 x1874627750209408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784831.112522:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750209408:0@lo:400:kworker.0 00000100:00100000:1.0:1787784831.112547:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750209792 00000100:00100000:1.0:1787784831.112551:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750209792 00000100:00100000:1.0:1787784831.112576:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787784831.112582:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2660f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17134:x1874627750209792:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1787784831.112796:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784831.112891:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750208512:0@lo:400:kworker.0 00000100:00100000:0.0:1787784831.112923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784831.112959:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750209152:0@lo:400:kworker.0 00000100:00100000:0.0:1787784831.112979:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784831.112995:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750209664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784831.113014:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784831.113033:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787784831.113039:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750208000:0@lo:400:kworker.0 00000100:00100000:0.0:1787784831.113064:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784831.113087:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750208640:0@lo:400:kworker.0 00000100:00100000:0.0:1787784831.113107:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784831.113122:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750209280:0@lo:400:kworker.0 00000100:00100000:0.0:1787784831.113143:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784831.113169:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750209664 00000100:00100000:0.0:1787784831.113173:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750209664 00000100:00100000:0.0:1787784831.113202:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784831.113209:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874627750209664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784831.113226:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787784831.113261:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874627750209664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784831.113267:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784831.113286:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750208000 00000100:00100000:0.0:1787784831.113295:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750208000 00000100:00100000:0.0:1787784831.113321:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787784831.113327:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3644:x1874627750208000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784831.113357:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3644:x1874627750208000:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784831.113362:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787784831.113385:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750208640 00000100:00100000:0.0:1787784831.113388:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750208640 00000100:00100000:0.0:1787784831.113411:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784831.113417:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750208640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784831.113445:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750208640:12345-0@lo:400:kworker.0 Request processed in 28us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784831.113452:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784831.113474:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750208512 00000100:00100000:0.0:1787784831.113477:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750208512 00000100:00100000:0.0:1787784831.113495:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750209152 00000100:00100000:0.0:1787784831.113498:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750209152 00000100:00100000:0.0:1787784831.113516:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750209280 00000100:00100000:0.0:1787784831.113518:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750209280 00000100:00100000:0.0:1787784831.113531:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787784831.113535:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750208512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784831.113562:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750208512:12345-0@lo:400:kworker.0 Request processed in 26us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784831.113569:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787784831.113579:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787784831.113584:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750209152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784831.113606:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750209152:12345-0@lo:400:kworker.0 Request processed in 22us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784831.113617:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787784831.113629:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787784831.113634:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750209280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784831.113657:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750209280:12345-0@lo:400:kworker.0 Request processed in 24us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784831.113662:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787784831.113678:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787784831.113681:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784831.113701:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750208000:0@lo:400:kworker.0 00000100:00100000:0.0:1787784831.113710:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750208640:0@lo:400:kworker.0 00010000:00080000:0.0:1787784831.113719:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3413840 x1874627750209280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784831.113728:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750209280:0@lo:400:kworker.0 00010000:00080000:0.0:1787784831.113737:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c43b0000 x1874627750208512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784831.113745:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750208512:0@lo:400:kworker.0 00010000:00080000:0.0:1787784831.113753:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c34130c0 x1874627750209152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784831.113761:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750209152:0@lo:400:kworker.0 00010000:00080000:0.0:1787784831.113796:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c26621c0 x1874627750209664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784831.113809:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750209664:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1787784831.114137:0:17133:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787784831.114227:0:17133:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 571363458258ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787784831.114234:0:17133:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787784831.114294:0:17851:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787784831.114314:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c41643c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17851:1874627750210048:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787784831.114350:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784831.114369:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa99ba80 going to sleep for 11 seconds 00000004:00080000:2.0:1787784831.114381:0:17850:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787784831.114423:0:17850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 571363653999ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787784831.114427:0:17850:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787784831.114569:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750210048 00000100:00100000:2.0:1787784831.114575:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750210048 00000100:00100000:2.0:1787784831.114614:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787784831.114622:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17851:x1874627750210048:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787784831.114666:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c41652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750209920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784831.114690:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787784831.114716:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784831.114724:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750209920 00000100:00100000:2.0:1787784831.114727:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750209920 00000100:00100000:2.0:1787784831.114748:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784831.114753:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4166580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874627750209920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787784831.114791:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787784831.114863:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4166580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874627750209920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784831.114870:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787784831.114910:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c41652c0 x1874627750209920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784831.114923:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c41652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750209920:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1787784831.118823:0:17840:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:2.0:1787784831.120503:0:18614:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787784831.120513:0:18614:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787784831.120520:0:18614:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:1.0:1787784831.122433:0:17087:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1787784831.124047:0:19016:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787784831.124056:0:19016:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787784831.124159:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17851:x1874627750210048:12345-0@lo:7:osp-pre-1-1.0 Request processed in 9531us (9801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784831.124170:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787784831.124683:0:17851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c41643c0 x1874627750210048/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787784847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784831.124702:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c41643c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17851:1874627750210048:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787784831.124719:0:17851:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787784831.124762:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17851:1874627750210176:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787784831.124822:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784831.125011:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa99ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784831.125029:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750210176 00000100:00100000:0.0:1787784831.125035:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750210176 00000100:00100000:0.0:1787784831.125114:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784831.125124:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17851:x1874627750210176:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787784831.125147:0:18613:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1787784831.125183:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17851:x1874627750210176:12345-0@lo:5:osp-pre-1-1.0 Request processed in 60us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784831.125189:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787784831.134170:0:17851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951e1ffed00 x1874627750210176/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784831.134190:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17851:1874627750210176:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787784831.134206:0:17851:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787784831.134257:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17851:1874627750210304:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787784831.134326:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784831.134360:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa99ba80 going to sleep for 11 seconds 00002000:00010000:2.0:1787784831.134373:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784831.134382:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002adcee5b/0x88ace7295d9e2c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784831.134382:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750210304 00000100:00100000:0.0:1787784831.134388:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750210304 00010000:00010000:2.0:1787784831.134399:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=571s v=(0 0) 00010000:00010000:2.0:1787784831.134404:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784831.134410:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002adcee5b/0x88ace7295d9e2c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.134427:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002adcee5b/0x88ace7295d9e2c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784831.134430:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787784831.134437:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002adcee5b/0x88ace7295d9e2c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.134445:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002adcee5b/0x88ace7295d9e2c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784831.134448:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17851:x1874627750210304:12345-0@lo:5:osp-pre-1-1.0 00010000:00010000:2.0:1787784831.134467:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784831.134480:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784831.134485:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002adcee5b/0x88ace7295d9e2c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787784831.134485:0:19016:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:2.0:1787784831.134492:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784831.134497:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002adcee5b/0x88ace7295d9e2c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.134506:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002adcee5b/0x88ace7295d9e2c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.134524:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002adcee5b/0x88ace7295d9e2c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.134531:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002adcee5b/0x88ace7295d9e2c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.134550:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.134552:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.134554:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784831.136047:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.136056:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9e2cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.136069:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.136073:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.136079:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9e2cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.136091:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9e2cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.136099:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9e2cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.136106:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9e2cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.136120:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784831.136205:0:19445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784831.136211:0:19445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9e2cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.136220:0:19445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784831.136224:0:19445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9e2cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.136238:0:19445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9e2cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.136252:0:19445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9e2cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.136261:0:19445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9e2cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.136280:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.136281:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.136283:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784831.137158:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.137165:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002da14848/0x88ace7295d9e2d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.137187:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.137192:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.137197:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002da14848/0x88ace7295d9e2d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.137207:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002da14848/0x88ace7295d9e2d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.137216:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002da14848/0x88ace7295d9e2d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.137229:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002da14848/0x88ace7295d9e2d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.137245:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784831.137330:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784831.137336:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002da14848/0x88ace7295d9e2d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.137345:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784831.137349:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002da14848/0x88ace7295d9e2d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.137356:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002da14848/0x88ace7295d9e2d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.137369:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002da14848/0x88ace7295d9e2d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.137376:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002da14848/0x88ace7295d9e2d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.137388:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.137390:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.137391:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784831.138712:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.138730:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9e2da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.138742:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.138746:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.138750:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9e2da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.138761:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9e2da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.138992:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9e2da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.139000:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9e2da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.139022:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784831.140431:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784831.140442:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9e2da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.140454:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784831.140465:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9e2da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.140476:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9e2da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.140497:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9e2da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.140506:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9e2da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.140529:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.140531:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.140532:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784831.143572:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784831.143587:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e2e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.143617:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1787784831.143621:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784831.143629:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e2e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.143644:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e2e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.143654:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e2e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.143662:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e2e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.143686:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784831.144749:0:19445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784831.144758:0:19445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e2e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.145468:0:19445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784831.145473:0:19445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e2e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.145483:0:19445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e2e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.145501:0:19445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e2e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.145509:0:19445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e2e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.145528:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.145530:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.145532:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784831.145835:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.145843:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a08dd2cc/0x88ace7295d9e2e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.145867:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.145872:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.145878:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a08dd2cc/0x88ace7295d9e2e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.145890:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a08dd2cc/0x88ace7295d9e2e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.145904:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a08dd2cc/0x88ace7295d9e2e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.145912:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a08dd2cc/0x88ace7295d9e2e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.145927:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784831.146135:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784831.146141:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a08dd2cc/0x88ace7295d9e2e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.146149:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784831.146152:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a08dd2cc/0x88ace7295d9e2e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.146160:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a08dd2cc/0x88ace7295d9e2e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.146172:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a08dd2cc/0x88ace7295d9e2e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.146191:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a08dd2cc/0x88ace7295d9e2e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.146209:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.146216:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.146218:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784831.146826:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.146834:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8f17702/0x88ace7295d9e2ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.146856:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.146861:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.146866:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8f17702/0x88ace7295d9e2ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.146876:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8f17702/0x88ace7295d9e2ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.146885:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8f17702/0x88ace7295d9e2ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.146893:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8f17702/0x88ace7295d9e2ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.146918:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787784831.147504:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.147514:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b97ff9bb/0x88ace7295d9e2f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.147525:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.147528:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.147533:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b97ff9bb/0x88ace7295d9e2f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.147549:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b97ff9bb/0x88ace7295d9e2f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.147558:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b97ff9bb/0x88ace7295d9e2f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.147566:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b97ff9bb/0x88ace7295d9e2f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.147584:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787784831.147727:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784831.147735:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8f17702/0x88ace7295d9e2ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.147744:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784831.147748:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8f17702/0x88ace7295d9e2ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.147758:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8f17702/0x88ace7295d9e2ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784831.148062:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.148069:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e2fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148078:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.148081:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.148085:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e2fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148095:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e2fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148102:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e2fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148120:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e2fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148133:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787784831.148309:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784831.148315:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b97ff9bb/0x88ace7295d9e2f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148323:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784831.148326:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b97ff9bb/0x88ace7295d9e2f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148334:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b97ff9bb/0x88ace7295d9e2f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148346:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b97ff9bb/0x88ace7295d9e2f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148353:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b97ff9bb/0x88ace7295d9e2f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148372:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784831.148376:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e2fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148393:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784831.148396:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e2fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148402:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e2fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148412:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e2fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148419:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e2fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148432:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.148433:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.148435:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784831.148653:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.148659:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e304 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148667:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.148670:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.148674:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148683:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148698:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148704:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.148717:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784831.149023:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784831.149028:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.149036:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784831.149039:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.149047:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e304 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.149059:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e304 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.149067:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e304 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.149081:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.149089:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.149091:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.149303:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784831.149745:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784831.149752:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e30b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.149761:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1787784831.149765:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784831.150365:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e30b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.150390:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e30b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.150400:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e30b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.150407:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e30b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.150428:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784831.150579:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8f17702/0x88ace7295d9e2ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.150584:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784831.150591:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e30b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.150595:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8f17702/0x88ace7295d9e2ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.150598:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784831.150609:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e30b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.150614:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.150615:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.150617:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.150617:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e30b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.150628:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e30b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.150635:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e30b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.150649:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.150650:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.150652:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784831.151425:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.151433:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006303c6d5/0x88ace7295d9e312 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.151446:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.151449:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.151460:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006303c6d5/0x88ace7295d9e312 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.151470:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006303c6d5/0x88ace7295d9e312 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.151479:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006303c6d5/0x88ace7295d9e312 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.151487:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006303c6d5/0x88ace7295d9e312 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.151501:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784831.151628:0:19445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784831.151634:0:19445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006303c6d5/0x88ace7295d9e312 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.151642:0:19445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784831.151646:0:19445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006303c6d5/0x88ace7295d9e312 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.151656:0:19445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006303c6d5/0x88ace7295d9e312 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.151668:0:19445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006303c6d5/0x88ace7295d9e312 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.151675:0:19445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006303c6d5/0x88ace7295d9e312 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.151697:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.151699:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.151701:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784831.152344:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.152351:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000142acb7b/0x88ace7295d9e319 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.152361:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.152364:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.152368:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000142acb7b/0x88ace7295d9e319 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.152377:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000142acb7b/0x88ace7295d9e319 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.152385:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000142acb7b/0x88ace7295d9e319 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.152401:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000142acb7b/0x88ace7295d9e319 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.152454:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787784831.152808:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.152814:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d73ca1c/0x88ace7295d9e320 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.152823:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.152826:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.152830:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d73ca1c/0x88ace7295d9e320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.152839:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d73ca1c/0x88ace7295d9e320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.152858:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d73ca1c/0x88ace7295d9e320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.152865:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d73ca1c/0x88ace7295d9e320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.153344:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784831.153351:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000142acb7b/0x88ace7295d9e319 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.153360:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784831.153363:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000142acb7b/0x88ace7295d9e319 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.153371:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000142acb7b/0x88ace7295d9e319 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.153386:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000142acb7b/0x88ace7295d9e319 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.153393:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000142acb7b/0x88ace7295d9e319 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.153411:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784831.153414:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d73ca1c/0x88ace7295d9e320 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.153420:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784831.153429:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d73ca1c/0x88ace7295d9e320 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.153436:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d73ca1c/0x88ace7295d9e320 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.153446:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d73ca1c/0x88ace7295d9e320 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.153454:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.153456:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.153458:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.155631:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787784831.155647:0:18614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d73ca1c/0x88ace7295d9e320 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.155819:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784831.156434:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.156508:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e327 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.156523:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.156527:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.156538:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.156552:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.156562:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.156570:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.156586:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787784831.157290:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.157297:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e32e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.157308:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.157312:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.157324:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e32e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.157335:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e32e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.157344:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e32e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.157351:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e32e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.157365:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787784831.158153:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.158246:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b887c5/0x88ace7295d9e335 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.158261:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.158265:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.158270:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b887c5/0x88ace7295d9e335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.158281:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005b887c5/0x88ace7295d9e335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.158290:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b887c5/0x88ace7295d9e335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.158310:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005b887c5/0x88ace7295d9e335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.158329:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787784831.158472:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787784831.158480:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158489:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784831.158494:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158503:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e327 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158519:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e327 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158527:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de3f49dc/0x88ace7295d9e327 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158546:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784831.158550:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e32e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158562:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784831.158565:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e32e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158574:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e32e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158585:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e32e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158592:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3dbfc5d/0x88ace7295d9e32e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158606:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784831.158609:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005b887c5/0x88ace7295d9e335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158616:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784831.158620:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b887c5/0x88ace7295d9e335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158628:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b887c5/0x88ace7295d9e335 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158637:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005b887c5/0x88ace7295d9e335 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158650:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005b887c5/0x88ace7295d9e335 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.158665:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.158666:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.158668:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784831.159108:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.159115:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c4b4de5/0x88ace7295d9e33c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.159124:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.159128:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.159132:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c4b4de5/0x88ace7295d9e33c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.159447:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c4b4de5/0x88ace7295d9e33c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.159457:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c4b4de5/0x88ace7295d9e33c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.159465:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c4b4de5/0x88ace7295d9e33c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.159478:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784831.159491:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784831.159496:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c4b4de5/0x88ace7295d9e33c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.159504:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784831.159508:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c4b4de5/0x88ace7295d9e33c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.159516:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c4b4de5/0x88ace7295d9e33c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.159527:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c4b4de5/0x88ace7295d9e33c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.159534:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c4b4de5/0x88ace7295d9e33c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.159548:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.159550:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.159552:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784831.159749:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.159755:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f18b5314/0x88ace7295d9e343 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.159800:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.159804:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.159808:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f18b5314/0x88ace7295d9e343 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.159817:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f18b5314/0x88ace7295d9e343 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.159825:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f18b5314/0x88ace7295d9e343 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.159832:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f18b5314/0x88ace7295d9e343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.159866:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784831.159878:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784831.159883:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f18b5314/0x88ace7295d9e343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.159890:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784831.159894:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f18b5314/0x88ace7295d9e343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.159902:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f18b5314/0x88ace7295d9e343 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.159913:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f18b5314/0x88ace7295d9e343 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.159921:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f18b5314/0x88ace7295d9e343 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.159934:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.159936:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.159938:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784831.160541:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.160548:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008418b858/0x88ace7295d9e34a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.160562:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.160565:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.160570:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008418b858/0x88ace7295d9e34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.160579:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008418b858/0x88ace7295d9e34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.160598:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008418b858/0x88ace7295d9e34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.160616:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008418b858/0x88ace7295d9e34a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.160633:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784831.160655:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784831.160659:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008418b858/0x88ace7295d9e34a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.160666:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784831.160669:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008418b858/0x88ace7295d9e34a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.160684:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.160687:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008418b858/0x88ace7295d9e34a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.160690:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.160699:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008418b858/0x88ace7295d9e34a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.160706:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008418b858/0x88ace7295d9e34a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.160721:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.160723:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.160725:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784831.161362:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.161370:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019cc38b3/0x88ace7295d9e351 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.161381:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.161385:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.161389:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019cc38b3/0x88ace7295d9e351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.161759:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019cc38b3/0x88ace7295d9e351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.161795:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019cc38b3/0x88ace7295d9e351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.161803:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019cc38b3/0x88ace7295d9e351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.161828:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787784831.162574:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784831.162581:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009319eeee/0x88ace7295d9e358 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.162596:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787784831.162609:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784831.162615:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009319eeee/0x88ace7295d9e358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.162626:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009319eeee/0x88ace7295d9e358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.162634:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009319eeee/0x88ace7295d9e358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.162642:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009319eeee/0x88ace7295d9e358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.162755:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787784831.163009:0:19445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784831.163017:0:19445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019cc38b3/0x88ace7295d9e351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163025:0:19445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784831.163029:0:19445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019cc38b3/0x88ace7295d9e351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163038:0:19445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019cc38b3/0x88ace7295d9e351 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163053:0:19445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019cc38b3/0x88ace7295d9e351 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163071:0:19445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019cc38b3/0x88ace7295d9e351 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163091:0:19445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784831.163094:0:19445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009319eeee/0x88ace7295d9e358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163101:0:19445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784831.163105:0:19445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009319eeee/0x88ace7295d9e358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163112:0:19445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009319eeee/0x88ace7295d9e358 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163122:0:19445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009319eeee/0x88ace7295d9e358 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163129:0:19445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009319eeee/0x88ace7295d9e358 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163139:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.163141:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.163143:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.163148:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784831.163810:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784831.163817:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e35f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163833:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1787784831.163837:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784831.163842:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163852:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163861:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163869:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.163884:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784831.164494:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784831.164501:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001695abed/0x88ace7295d9e366 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.164511:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1787784831.164514:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784831.164519:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001695abed/0x88ace7295d9e366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.164527:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001695abed/0x88ace7295d9e366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.164546:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001695abed/0x88ace7295d9e366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.164553:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001695abed/0x88ace7295d9e366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.164575:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787784831.164999:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784831.165005:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f42f94/0x88ace7295d9e36d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165014:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1787784831.165018:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784831.165022:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034f42f94/0x88ace7295d9e36d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165031:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034f42f94/0x88ace7295d9e36d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165039:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f42f94/0x88ace7295d9e36d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165047:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034f42f94/0x88ace7295d9e36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165071:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787784831.165080:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787784831.165085:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165093:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784831.165097:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165107:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e35f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165121:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e35f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165128:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0af91e4/0x88ace7295d9e35f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165143:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784831.165146:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001695abed/0x88ace7295d9e366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165153:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784831.165156:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001695abed/0x88ace7295d9e366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165174:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001695abed/0x88ace7295d9e366 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.165278:0:19445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784831.165285:0:19445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034f42f94/0x88ace7295d9e36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.165293:0:19445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784831.165304:0:19445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f42f94/0x88ace7295d9e36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.165312:0:19445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f42f94/0x88ace7295d9e36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.165323:0:19445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034f42f94/0x88ace7295d9e36d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.165331:0:19445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034f42f94/0x88ace7295d9e36d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.165345:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.165347:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.165348:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.165971:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001695abed/0x88ace7295d9e366 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165980:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001695abed/0x88ace7295d9e366 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.165994:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.165995:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.165998:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.166366:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784831.169263:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784831.169377:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb0596/0x88ace7295d9e374 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.169395:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1787784831.169400:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784831.169407:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb0596/0x88ace7295d9e374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.169422:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032eb0596/0x88ace7295d9e374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.169433:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb0596/0x88ace7295d9e374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.169457:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb0596/0x88ace7295d9e374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.169484:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784831.169528:0:19445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784831.169535:0:19445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032eb0596/0x88ace7295d9e374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.169542:0:19445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784831.169546:0:19445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb0596/0x88ace7295d9e374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.169555:0:19445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb0596/0x88ace7295d9e374 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.169570:0:19445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032eb0596/0x88ace7295d9e374 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.169584:0:19445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb0596/0x88ace7295d9e374 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784831.169605:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.169607:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784831.169609:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784831.171124:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784831.171133:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099b8e024/0x88ace7295d9e37b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.171145:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1787784831.171150:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784831.171155:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099b8e024/0x88ace7295d9e37b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.171166:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099b8e024/0x88ace7295d9e37b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.171174:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099b8e024/0x88ace7295d9e37b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.171181:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099b8e024/0x88ace7295d9e37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.171198:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784831.171487:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784831.171493:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099b8e024/0x88ace7295d9e37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.171510:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784831.171514:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099b8e024/0x88ace7295d9e37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.171522:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099b8e024/0x88ace7295d9e37b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.171536:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099b8e024/0x88ace7295d9e37b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.171544:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099b8e024/0x88ace7295d9e37b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.171560:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.171561:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784831.171563:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787784831.175108:0:19429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1787784831.175135:0:19429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787784831.175140:0:19429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787784831.175609:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17851:x1874627750210304:12345-0@lo:5:osp-pre-1-1.0 Request processed in 41156us (41276us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787784831.175619:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00002000:00010000:3.0:1787784831.175621:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784831.175628:0:18614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e23911d4/0x88ace7295d9e382 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.175643:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1787784831.175647:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784831.175653:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e23911d4/0x88ace7295d9e382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.175665:0:18614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e23911d4/0x88ace7295d9e382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.175681:0:18614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e23911d4/0x88ace7295d9e382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.175689:0:18614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e23911d4/0x88ace7295d9e382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784831.175711:0:18614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787784831.175760:0:18614:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1787784831.175821:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2660f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17134:x1874627750209792:12345-0@lo:5:osp-pre-1-0.0 Request processed in 63239us (63420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784831.175828:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787784831.175874:0:17134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2663480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17134:1874627750209792:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787784831.175890:0:17134:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1787784831.175933:0:17134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17134:1874627750210432:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787784831.175962:0:17851:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787784831.175969:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17851:1874627750210304:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787784831.175979:0:17851:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787784831.175980:0:17134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784831.176001:0:17134:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784831.176011:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1ffed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17851:1874627750210560:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787784831.176017:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750210432 00000100:00100000:3.0:1787784831.176022:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750210432 00000100:00100000:0.0:1787784831.176036:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784831.176053:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d27900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784831.176060:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787784831.176068:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17134:x1874627750210432:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787784831.176068:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750210560 00000100:00100000:0.0:1787784831.176071:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750210560 00000100:00100000:0.0:1787784831.176095:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784831.176100:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17851:x1874627750210560:12345-0@lo:900:osp-pre-1-1.0 00002000:00080000:3.0:1787784831.176101:0:18612:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1787784831.176137:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17851:x1874627750210560:12345-0@lo:900:osp-pre-1-1.0 Request processed in 36us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784831.176144:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787784831.176172:0:17851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951e1ffed00 x1874627750210560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787784847 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787784831.178360:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784831.178372:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e23911d4/0x88ace7295d9e382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.178385:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784831.178390:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e23911d4/0x88ace7295d9e382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.178413:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e23911d4/0x88ace7295d9e382 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.178432:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e23911d4/0x88ace7295d9e382 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.178441:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e23911d4/0x88ace7295d9e382 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784831.178462:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.178464:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784831.178466:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784831.178559:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1ffed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17851:1874627750210560:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787784831.181571:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17134:x1874627750210432:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5498us (5585us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787784831.181585:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784831.181587:0:17134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17134:1874627750210432:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787784831.181602:0:17134:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000001:02000400:2.0:1787784831.983197:0:19785:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787784832.084269:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784833.097318:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787784833.102448:0:19837:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784833.102666:0:19837:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1787784834.113722:0:19887:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787784834.114225:0:19887:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787784834.118094:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784834.189733:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750210688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784834.189853:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784834.190068:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750210688 00000100:00100000:3.0:1787784834.190076:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750210688 00000100:00100000:3.0:1787784834.190132:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787784834.190142:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750210688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784834.190174:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787784834.190223:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750210688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784834.190231:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787784834.190252:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784834.190290:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750210688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784834.405711:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784834.406083:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728103552 00000100:00100000:3.0:1787784834.406092:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728103552 00000100:00100000:3.0:1787784834.406141:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 116 00000100:00100000:3.0:1787784834.406149:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2404:x1874627728103552:12345-192.168.202.41@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787784834.406176:0:17102:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1cb1bd3c-6bfa-442d-a41e-20c87a4d4182@192.168.202.41@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:3.0:1787784834.406203:0:17102:0:(genops.c:1385:class_connect()) connect: client 1cb1bd3c-6bfa-442d-a41e-20c87a4d4182, cookie 0x88ace7295d9e389 00000100:00080000:3.0:1787784834.406355:0:17102:0:(import.c:65:import_set_state_nolock()) ffff8951fd5be800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784834.406490:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+5:2404:x1874627728103552:12345-192.168.202.41@tcp:250:mount.lustre.0 Request processed in 340us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784834.406498:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 116 00000100:00100000:3.0:1787784834.413558:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784834.414025:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728103680 00000100:00100000:0.0:1787784834.414035:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728103680 00000100:00100000:0.0:1787784834.414130:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 117 00000100:00100000:0.0:1787784834.414141:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+5:14903:x1874627728103680:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784834.414160:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784834.414181:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9e390 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72d9c expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784834.414215:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9e390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d9c expref: 6 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784834.414228:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9e390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d9c expref: 6 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784834.414238:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34a00, rc 0) 00000100:00100000:0.0:1787784834.414314:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+6:14903:x1874627728103680:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 175us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784834.414322:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 117 00000100:00100000:2.0:1787784834.419210:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784834.419410:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728103808 00000100:00100000:0.0:1787784834.419420:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728103808 00000100:00100000:0.0:1787784834.419481:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 118 00000100:00100000:0.0:1787784834.419491:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+6:14903:x1874627728103808:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787784834.420020:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+6:14903:x1874627728103808:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 528us (817us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787784834.420028:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 118 00000100:00100000:2.0:1787784834.430418:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784834.430541:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728103936 00000100:00100000:0.0:1787784834.430550:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728103936 00000100:00100000:0.0:1787784834.431023:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:0.0:1787784834.431035:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+6:14903:x1874627728103936:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784834.431052:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784834.431069:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e397 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72da3 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784834.431102:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72da3 expref: 7 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784834.431114:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72da3 expref: 7 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784834.431124:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34600, rc 0) 00000100:00100000:0.0:1787784834.431185:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+7:14903:x1874627728103936:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 152us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784834.431192:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:2.0:1787784834.441478:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784834.441615:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728104064 00000100:00100000:0.0:1787784834.441623:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728104064 00000100:00100000:3.0:1787784834.442076:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00100000:3.0:1787784834.442090:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+7:14903:x1874627728104064:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787784834.442385:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+8:14903:x1874627728104064:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 298us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784834.442393:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00100000:2.0:1787784834.448985:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784834.449097:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728104192 00000100:00100000:0.0:1787784834.449107:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728104192 00000100:00100000:0.0:1787784834.449201:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 121 00000100:00100000:0.0:1787784834.449211:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+8:14903:x1874627728104192:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787784834.449389:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+8:14903:x1874627728104192:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 179us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784834.449397:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 121 00000100:00100000:3.0:1787784834.453034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784834.453236:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728104320 00000100:00100000:1.0:1787784834.453248:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728104320 00000100:00100000:1.0:1787784834.453355:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 122 00000100:00100000:1.0:1787784834.453365:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+8:14921:x1874627728104320:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784834.453676:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+8:14921:x1874627728104320:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 311us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784834.453685:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 122 00000100:00100000:1.0:1787784834.493100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784834.493227:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728104448 00000100:00100000:0.0:1787784834.493253:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728104448 00000100:00100000:0.0:1787784834.493317:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 123 00000100:00100000:0.0:1787784834.493446:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+8:14921:x1874627728104448:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784834.493853:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+8:14921:x1874627728104448:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 525us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784834.493861:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 123 00000100:00100000:0.0:1787784834.515958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784834.516084:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728104576 00000100:00100000:1.0:1787784834.516094:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728104576 00000100:00100000:1.0:1787784834.516157:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00100000:1.0:1787784834.516168:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d2477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+8:14921:x1874627728104576:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784834.516330:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d2477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+8:14921:x1874627728104576:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 164us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784834.516347:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00100000:2.0:1787784834.528322:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784834.528937:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728104704 00000100:00100000:0.0:1787784834.528947:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728104704 00000100:00100000:0.0:1787784834.529006:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 125 00000100:00100000:0.0:1787784834.529017:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d2477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+8:14903:x1874627728104704:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784834.529034:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784834.529050:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e39e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72dd4 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784834.529080:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72dd4 expref: 9 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784834.529092:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72dd4 expref: 9 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784834.529101:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35600, rc 0) 00000100:00100000:0.0:1787784834.529164:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d2477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+9:14903:x1874627728104704:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 148us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784834.529172:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 125 00000100:00100000:1.0:1787784834.547643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784834.551380:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728104832 00000100:00100000:2.0:1787784834.551414:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728104832 00000100:00100000:2.0:1787784834.551479:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 126 00000100:00100000:2.0:1787784834.551489:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d2475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+9:14903:x1874627728104832:12345-192.168.202.41@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787784834.551515:0:17102:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787784834.551532:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787784834.551537:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787784834.551540:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787784834.551543:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787784834.551545:0:17102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1787784834.561179:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d2475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+9:14903:x1874627728104832:12345-192.168.202.41@tcp:256:mount.lustre.0 Request processed in 9679us (13534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784834.561205:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 126 00000100:00100000:2.0:1787784834.564019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784834.564157:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728104960 00000100:00100000:1.0:1787784834.564168:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728104960 00000100:00100000:1.0:1787784834.564235:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 127 00000100:00100000:1.0:1787784834.564246:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c2dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+9:14903:x1874627728104960:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787784834.564261:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784834.564279:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df602400/0x88ace7295d9e3a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ddb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784834.564309:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602400/0x88ace7295d9e3a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ddb expref: 10 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784834.564321:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df602400/0x88ace7295d9e3a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ddb expref: 10 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784834.564342:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602400, rc 0) 00000100:00100000:1.0:1787784834.564446:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c2dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:14903:x1874627728104960:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 202us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784834.564454:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 127 00000100:00100000:0.0:1787784834.579971:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784834.580362:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728105088 00000100:00100000:3.0:1787784834.580371:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728105088 00000100:00100000:3.0:1787784834.580424:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 128 00000100:00100000:3.0:1787784834.580433:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c7810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:14903:x1874627728105088:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787784834.580577:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c7810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:14903:x1874627728105088:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 139us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784834.580584:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 128 00000100:00100000:2.0:1787784834.586002:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784834.586110:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728105216 00000100:00100000:0.0:1787784834.586131:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728105216 00000100:00100000:0.0:1787784834.586186:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 129 00000100:00100000:0.0:1787784834.586195:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:14903:x1874627728105216:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787784834.586368:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:14903:x1874627728105216:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 172us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784834.586375:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 129 00000100:00100000:2.0:1787784834.600496:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784834.600604:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728105344 00000100:00100000:1.0:1787784834.600629:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728105344 00000100:00100000:1.0:1787784834.600691:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 130 00000100:00100000:1.0:1787784834.600700:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ce8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:14926:x1874627728105344:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784834.600890:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ce8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:14926:x1874627728105344:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 190us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784834.600899:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 130 00000100:00100000:1.0:1787784834.613306:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784834.613529:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728105472 00000100:00100000:3.0:1787784834.613543:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728105472 00000100:00100000:3.0:1787784834.613612:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 131 00000100:00100000:3.0:1787784834.613624:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:14926:x1874627728105472:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784834.613878:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:14926:x1874627728105472:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 255us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784834.613888:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 131 00000100:00100000:2.0:1787784834.627827:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784834.627937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784834.628266:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728105600 00000100:00100000:1.0:1787784834.628279:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728105600 00000100:00100000:1.0:1787784834.628335:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728105856 00000100:00100000:1.0:1787784834.628338:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728105856 00000100:00100000:1.0:1787784834.628365:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1787784834.628385:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c41652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2404:x1874627728105600:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787784834.628426:0:17107:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 41f7da42-7119-46f9-b18b-692347fcebc0@192.168.202.41@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:1.0:1787784834.628495:0:17107:0:(genops.c:1385:class_connect()) connect: client 41f7da42-7119-46f9-b18b-692347fcebc0, cookie 0x88ace7295d9e3ac 00000004:00100000:1.0:1787784834.628531:0:17107:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787784834.628846:0:17107:0:(import.c:65:import_set_state_nolock()) ffff8951cfe45000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784834.628943:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c41652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+6:2404:x1874627728105600:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 567us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784834.628951:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1787784834.628975:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:1.0:1787784834.628979:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4167c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2404:x1874627728105856:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787784834.628996:0:17107:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 41f7da42-7119-46f9-b18b-692347fcebc0@192.168.202.41@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:1.0:1787784834.629030:0:17107:0:(genops.c:1385:class_connect()) connect: client 41f7da42-7119-46f9-b18b-692347fcebc0, cookie 0x88ace7295d9e3b3 00000004:00100000:1.0:1787784834.629044:0:17107:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787784834.629256:0:17107:0:(import.c:65:import_set_state_nolock()) ffff8951ff02a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784834.629283:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4167c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+6:2404:x1874627728105856:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 302us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784834.629290:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:2.0:1787784834.649360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784834.649424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784834.649683:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728105984 00000100:00100000:3.0:1787784834.649697:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728105984 00000100:00100000:3.0:1787784834.649811:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728105728 00000100:00100000:3.0:1787784834.649815:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728105728 00000100:00100000:3.0:1787784834.649845:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:3.0:1787784834.649858:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4167840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+6:0:x1874627728105984:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787784834.649923:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787784834.650047:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4167840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+6:0:x1874627728105984:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 191us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784834.650055:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:3.0:1787784834.650095:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:3.0:1787784834.650102:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c41643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+6:0:x1874627728105728:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787784834.650122:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787784834.650182:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c41643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+6:0:x1874627728105728:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 80us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784834.650190:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00080000:0.0:1787784834.651390:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784834.651400:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787784834.656263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784834.656441:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728106112 00000100:00100000:3.0:1787784834.656455:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728106112 00000100:00100000:3.0:1787784834.656541:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:3.0:1787784834.656554:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+6:14903:x1874627728106112:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787784834.656611:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787784834.656725:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+6:14903:x1874627728106112:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 173us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784834.656733:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:2.0:1787784834.676578:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784834.676736:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728106240 00000100:00100000:0.0:1787784834.676748:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728106240 00000100:00100000:0.0:1787784834.676896:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:0.0:1787784834.676907:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+6:14903:x1874627728106240:12345-192.168.202.41@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787784834.677052:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+6:14903:x1874627728106240:12345-192.168.202.41@tcp:40:mount.lustre.0 Request processed in 146us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784834.677061:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:0.0:1787784834.690157:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784834.690391:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728106368 00000100:00100000:2.0:1787784834.690405:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728106368 00000100:00100000:2.0:1787784834.690477:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:2.0:1787784834.690488:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2404:x1874627728106368:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787784834.690538:0:19016:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 41f7da42-7119-46f9-b18b-692347fcebc0@192.168.202.41@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:2.0:1787784834.690651:0:19016:0:(genops.c:1385:class_connect()) connect: client 41f7da42-7119-46f9-b18b-692347fcebc0, cookie 0x88ace7295d9e3ba 00002000:00100000:2.0:1787784834.690670:0:19016:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 41f7da42-7119-46f9-b18b-692347fcebc0/ffff8950c360d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787784834.690685:0:19016:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787784834.691432:0:19016:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787784834.691480:0:19016:0:(import.c:65:import_set_state_nolock()) ffff8950c360e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784834.692081:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41f7da42-7119-46f9-b18b-692347fcebc0+6:2404:x1874627728106368:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 1589us (2522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784834.692093:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1787784834.694334:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784834.694372:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750210816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784834.694471:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784834.694540:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750210816 00000100:00100000:1.0:1787784834.694549:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750210816 00000100:00100000:1.0:1787784834.694620:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787784834.694630:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2662580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750210816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787784834.694666:0:17623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787784834.694718:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2662580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750210816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784834.694726:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787784834.694829:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750210816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784834.702247:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784834.702552:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784834.703101:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728106496 00000100:00100000:1.0:1787784834.703126:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728106496 00000100:00100000:1.0:1787784834.703191:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:1.0:1787784834.703202:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2404:x1874627728106496:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787784834.703249:0:18613:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 41f7da42-7119-46f9-b18b-692347fcebc0@192.168.202.41@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:1.0:1787784834.703296:0:18613:0:(genops.c:1385:class_connect()) connect: client 41f7da42-7119-46f9-b18b-692347fcebc0, cookie 0x88ace7295d9e3c1 00002000:00100000:1.0:1787784834.703312:0:18613:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 41f7da42-7119-46f9-b18b-692347fcebc0/ffff8951ff02e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787784834.703337:0:18613:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787784834.703559:0:18613:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787784834.703664:0:18613:0:(import.c:65:import_set_state_nolock()) ffff8951ff028800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784834.703749:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+6:2404:x1874627728106496:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 546us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784834.703757:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:3.0:1787784834.710224:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728106624 00000100:00100000:3.0:1787784834.710245:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728106624 00000100:00100000:3.0:1787784834.710380:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:3.0:1787784834.710394:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:41f7da42-7119-46f9-b18b-692347fcebc0+6:14903:x1874627728106624:12345-192.168.202.41@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787784834.710528:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:41f7da42-7119-46f9-b18b-692347fcebc0+6:14903:x1874627728106624:12345-192.168.202.41@tcp:900:mount.lustre.0 Request processed in 136us (8296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784834.710537:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:2.0:1787784834.716562:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784834.716752:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728106752 00000100:00100000:3.0:1787784834.716810:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728106752 00000100:00100000:3.0:1787784834.716878:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:3.0:1787784834.716891:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c41661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41f7da42-7119-46f9-b18b-692347fcebc0+6:14903:x1874627728106752:12345-192.168.202.41@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787784834.719675:0:17110:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2631us 00000004:00200000:0.0:1787784834.767436:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787784834.767633:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c41661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41f7da42-7119-46f9-b18b-692347fcebc0+6:14903:x1874627728106752:12345-192.168.202.41@tcp:33:mount.lustre.0 Request processed in 50736us (51078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784834.767653:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:2.0:1787784834.989598:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784834.997572:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728106880 00000100:00100000:3.0:1787784834.997592:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728106880 00000100:00100000:3.0:1787784834.997696:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:3.0:1787784834.997711:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3576580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+6:14949:x1874627728106880:12345-192.168.202.41@tcp:101:mkdir.0 00010000:00010000:3.0:1787784834.997740:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784834.997797:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e3c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72e0c expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784834.997885:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e3cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784834.997904:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e3cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784834.997930:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e3cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784834.997993:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787784834.997998:0:17109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787784834.998046:0:17109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e3cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784834.998079:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e3c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e0c expref: 8 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784834.998105:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e3cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e0c expref: 7 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784834.998129:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f512c600) 00010000:00010000:3.0:1787784834.998151:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784834.998156:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0030400, rc 0) 00000100:00100000:3.0:1787784834.998263:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3576580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+7:14949:x1874627728106880:12345-192.168.202.41@tcp:101:mkdir.0 Request processed in 555us (8683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784834.998272:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00010000:00010000:0.0:1787784835.144306:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784835.206681:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750210944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784835.206836:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784835.206927:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784835.206934:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750211072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784835.206961:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784835.207054:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750211072 00000100:00100000:0.0:1787784835.207064:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750211072 00000100:00100000:0.0:1787784835.207155:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784835.207165:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3577840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750211072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784835.207210:0:17112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787784835.207272:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3577840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750211072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784835.207280:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787784835.207484:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750211072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784835.207564:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750210944 00000100:00100000:3.0:1787784835.207569:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750210944 00000100:00100000:3.0:1787784835.207624:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787784835.207633:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750210944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784835.207651:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787784835.207707:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750210944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784835.207714:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784835.207843:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750210944:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787784835.208099:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787784836.167134:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784836.231088:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750211456:0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.231395:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784836.231454:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750211968:0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.231487:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784836.231509:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750212480:0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.231530:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784836.231545:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750212992:0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.231572:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784836.231600:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787784836.231606:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750211584:0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.231658:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784836.231681:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750212096:0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.231703:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784836.231720:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750212608:0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.231741:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784836.231806:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750211968 00000100:00100000:0.0:1787784836.231814:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750211968 00000100:00100000:0.0:1787784836.231945:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750212480 00000100:00100000:0.0:1787784836.231948:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750212480 00000100:00100000:0.0:1787784836.231960:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750212992 00000100:00100000:0.0:1787784836.231961:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750212992 00000100:00100000:3.0:1787784836.232172:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750211328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784836.232235:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784836.232260:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c56283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750211840:0@lo:400:kworker.0 00000100:00100000:3.0:1787784836.232286:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784836.232304:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5629e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750212352:0@lo:400:kworker.0 00000100:00100000:3.0:1787784836.232331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784836.232349:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750212864:0@lo:400:kworker.0 00000100:00100000:3.0:1787784836.232378:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784836.232391:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787784836.232397:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750211200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784836.232415:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784836.232430:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750211712:0@lo:400:kworker.0 00000100:00100000:3.0:1787784836.232451:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784836.232474:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750212224:0@lo:400:kworker.0 00000100:00100000:3.0:1787784836.232496:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784836.232514:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750212736:0@lo:400:kworker.0 00000100:00100000:3.0:1787784836.232533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784836.232570:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750211840 00000100:00100000:3.0:1787784836.232574:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750211840 00000100:00100000:3.0:1787784836.232609:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750212352 00000100:00100000:3.0:1787784836.232612:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750212352 00000100:00100000:3.0:1787784836.232626:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750211712 00000100:00100000:3.0:1787784836.232628:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750211712 00000100:00100000:3.0:1787784836.232639:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750212224 00000100:00100000:3.0:1787784836.232641:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750212224 00000100:00100000:3.0:1787784836.232656:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787784836.232665:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750211840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784836.232959:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750211840:12345-0@lo:400:kworker.0 Request processed in 293us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784836.232967:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787784836.233058:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784836.233066:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750212352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784836.233097:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750212352:12345-0@lo:400:kworker.0 Request processed in 33us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784836.233102:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784836.233250:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787784836.233261:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750211712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784836.233302:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750211712:12345-0@lo:400:kworker.0 Request processed in 45us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784836.233308:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784836.233430:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750212608 00000100:00100000:0.0:1787784836.233436:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750212608 00000100:00100000:0.0:1787784836.233453:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750212864 00000100:00100000:0.0:1787784836.233457:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750212864 00000100:00100000:0.0:1787784836.233471:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750212736 00000100:00100000:0.0:1787784836.233473:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750212736 00000100:00100000:0.0:1787784836.233487:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784836.233495:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5628780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750211968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.233542:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5628780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750211968:12345-0@lo:400:kworker.0 Request processed in 48us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784836.233549:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784836.233562:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787784836.233568:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750212480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.233598:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750212480:12345-0@lo:400:kworker.0 Request processed in 31us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784836.233604:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787784836.233616:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787784836.233623:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750212992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.233652:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750212992:12345-0@lo:400:kworker.0 Request processed in 30us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784836.233658:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787784836.233669:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784836.233675:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750212608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.233701:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750212608:12345-0@lo:400:kworker.0 Request processed in 27us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784836.233718:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784836.233729:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787784836.233734:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750212864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.233799:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750212864:12345-0@lo:400:kworker.0 Request processed in 64us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784836.233805:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787784836.233816:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784836.233822:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5317840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750212736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.233848:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5317840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750212736:12345-0@lo:400:kworker.0 Request processed in 27us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784836.233853:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784836.233877:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750211584 00000100:00100000:0.0:1787784836.233882:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750211584 00000100:00100000:0.0:1787784836.233918:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750212096 00000100:00100000:0.0:1787784836.233922:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750212096 00000100:00100000:0.0:1787784836.233936:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787784836.233942:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750211584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.233989:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750211584:12345-0@lo:400:kworker.0 Request processed in 47us (2331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784836.233995:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787784836.234006:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787784836.234011:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750212096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.234037:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750212096:12345-0@lo:400:kworker.0 Request processed in 26us (2333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784836.234042:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787784836.234092:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750211584:0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.234103:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750212096:0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.234126:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750212608:0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.234139:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750211968:0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.234150:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750212480:0@lo:400:kworker.0 00010000:00080000:0.0:1787784836.234163:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c56292c0 x1874627750212992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784836.234174:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750212992:0@lo:400:kworker.0 00000100:00100000:3.0:1787784836.234482:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787784836.234494:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750212224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784836.234533:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750212224:12345-0@lo:400:kworker.0 Request processed in 44us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784836.234540:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784836.234732:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750211456 00000100:00100000:1.0:1787784836.234748:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750211456 00000100:00100000:1.0:1787784836.234807:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787784836.234815:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3644:x1874627750211456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784836.234855:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3644:x1874627750211456:12345-0@lo:400:kworker.0 Request processed in 43us (3463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784836.234861:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1787784836.234947:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784836.234954:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784836.234958:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787784836.234962:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784836.234996:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750211328 00000100:00100000:1.0:1787784836.235003:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750211328 00000100:00100000:1.0:1787784836.235024:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750211200 00000100:00100000:1.0:1787784836.235028:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750211200 00000100:00100000:1.0:1787784836.235041:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787784836.235048:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750211328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784836.235075:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787784836.235124:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874627750211328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784836.235130:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787784836.235141:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784836.235154:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5291a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750211200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787784836.235167:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787784836.235205:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5291a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750211200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (2776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784836.235211:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784836.235259:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750211200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784836.235276:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750211712:0@lo:400:kworker.0 00000100:00100000:1.0:1787784836.235289:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750212224:0@lo:400:kworker.0 00010000:00080000:1.0:1787784836.235303:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c562bc00 x1874627750212736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784836.235313:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750212736:0@lo:400:kworker.0 00000100:00100000:1.0:1787784836.235329:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c26630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750211328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784836.235341:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c56283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750211840:0@lo:400:kworker.0 00000100:00100000:1.0:1787784836.235350:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5629e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750212352:0@lo:400:kworker.0 00000100:00100000:1.0:1787784836.235363:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750212864:0@lo:400:kworker.0 00000100:00100000:0.0:1787784836.238443:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750211456:0@lo:400:kworker.0 00000040:00080000:0.0:1787784836.678689:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1787784836.751363:0:19429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41f7da42-7119-46f9-b18b-692347fcebc0 00000001:00080000:3.0:1787784836.751380:0:19429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:2.0:1787784837.191447:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784837.338054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784837.338383:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728107008 00000100:00100000:0.0:1787784837.338392:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728107008 00000100:00100000:0.0:1787784837.338506:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:0.0:1787784837.338515:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+7:15002:x1874627728107008:12345-192.168.202.41@tcp:41:lfs.0 00000004:00000024:0.0:1787784837.338568:0:17108:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787784837.338680:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+7:15002:x1874627728107008:12345-192.168.202.41@tcp:41:lfs.0 Request processed in 165us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784837.338843:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:3.0:1787784837.342322:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00080000:1.0:1787784837.342435:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784837.343841:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728107136 00000100:00100000:2.0:1787784837.343856:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728107136 00000100:00100000:2.0:1787784837.343958:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:2.0:1787784837.343970:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5316d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+6:15002:x1874627728107136:12345-192.168.202.41@tcp:41:lfs.0 00000100:00080000:1.0:1787784837.343996:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1787784837.344009:0:17109:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787784837.344109:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5316d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+6:15002:x1874627728107136:12345-192.168.202.41@tcp:41:lfs.0 Request processed in 140us (1795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784837.344117:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:3.0:1787784837.359604:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784837.360480:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728107264 00000100:00100000:1.0:1787784837.360491:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728107264 00000100:00100000:1.0:1787784837.360585:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:1.0:1787784837.360597:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41f7da42-7119-46f9-b18b-692347fcebc0+6:15002:x1874627728107264:12345-192.168.202.41@tcp:13:lfs.0 00002000:00000024:1.0:1787784837.360649:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787784837.360813:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41f7da42-7119-46f9-b18b-692347fcebc0+6:15002:x1874627728107264:12345-192.168.202.41@tcp:13:lfs.0 Request processed in 218us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784837.360822:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00080000:0.0:1787784837.361674:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784837.370430:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784837.372377:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728107392 00000100:00100000:3.0:1787784837.372391:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728107392 00000100:00100000:3.0:1787784837.372561:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:3.0:1787784837.372572:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2661e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41f7da42-7119-46f9-b18b-692347fcebc0+5:15002:x1874627728107392:12345-192.168.202.41@tcp:13:lfs.0 00002000:00000024:3.0:1787784837.372600:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787784837.372712:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2661e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41f7da42-7119-46f9-b18b-692347fcebc0+5:15002:x1874627728107392:12345-192.168.202.41@tcp:13:lfs.0 Request processed in 141us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784837.372720:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00080000:0.0:1787784837.380608:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784837.616128:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784837.616257:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728107520 00000100:00100000:1.0:1787784837.616274:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728107520 00000100:00100000:1.0:1787784837.616363:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 133 00000100:00100000:1.0:1787784837.616373:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8952021e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:15036:x1874627728107520:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787784837.616392:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784837.616411:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df603000/0x88ace7295d9e3d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72e13 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784837.616442:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603000/0x88ace7295d9e3d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e13 expref: 11 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784837.616453:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df603000/0x88ace7295d9e3d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e13 expref: 11 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784837.616462:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603000, rc 0) 00000100:00100000:1.0:1787784837.616541:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8952021e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:15036:x1874627728107520:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 168us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784837.616548:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 133 00000100:00100000:1.0:1787784837.630585:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784837.630710:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728107648 00000100:00100000:3.0:1787784837.630725:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728107648 00000100:00100000:3.0:1787784837.630851:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:3.0:1787784837.630865:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8952021e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:15036:x1874627728107648:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787784837.632122:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8952021e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:15036:x1874627728107648:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 1248us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784837.632137:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:2.0:1787784837.647194:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784837.647317:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728107776 00000100:00100000:0.0:1787784837.647332:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728107776 00000100:00100000:0.0:1787784837.647421:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00100000:0.0:1787784837.647434:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:15036:x1874627728107776:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787784837.647649:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:15036:x1874627728107776:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 217us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784837.647659:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00100000:2.0:1787784837.661432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784837.663062:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728107904 00000100:00100000:3.0:1787784837.663082:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728107904 00000100:00100000:3.0:1787784837.663173:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 136 00000100:00100000:3.0:1787784837.663186:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:15041:x1874627728107904:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784837.663754:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:15041:x1874627728107904:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 567us (2336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784837.663831:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 136 00000100:00100000:3.0:1787784837.702212:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784837.702328:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728108032 00000100:00100000:1.0:1787784837.702342:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728108032 00000100:00100000:1.0:1787784837.702417:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 137 00000100:00100000:1.0:1787784837.702441:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:15041:x1874627728108032:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784837.702746:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:15041:x1874627728108032:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 306us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784837.702753:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 137 00000100:00100000:2.0:1787784837.709305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784837.716723:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728108160 00000100:00100000:3.0:1787784837.716748:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728108160 00000100:00100000:3.0:1787784837.718295:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 138 00000100:00100000:3.0:1787784837.718313:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:15041:x1874627728108160:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784837.718566:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:15041:x1874627728108160:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 256us (9278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784837.718576:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 138 00000100:00100000:2.0:1787784837.724039:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784837.724208:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728108288 00000100:00100000:1.0:1787784837.724221:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728108288 00000100:00100000:1.0:1787784837.724446:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 139 00000100:00100000:1.0:1787784837.724456:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:15036:x1874627728108288:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787784837.724478:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784837.724504:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df603800/0x88ace7295d9e3dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72e44 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784837.724539:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603800/0x88ace7295d9e3dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e44 expref: 12 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784837.724598:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df603800/0x88ace7295d9e3dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e44 expref: 12 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784837.724607:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603800, rc 0) 00000100:00100000:1.0:1787784837.724675:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:15036:x1874627728108288:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 222us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784837.724681:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 139 00000100:00100000:1.0:1787784837.729759:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784837.729950:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728108416 00000100:00100000:0.0:1787784837.729967:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728108416 00000100:00100000:0.0:1787784837.730040:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00100000:0.0:1787784837.730053:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:15036:x1874627728108416:12345-192.168.202.41@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787784837.730094:0:17100:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787784837.730130:0:17100:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787784837.730135:0:17100:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787784837.730138:0:17100:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787784837.730141:0:17100:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787784837.730144:0:17100:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787784837.733154:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:15036:x1874627728108416:12345-192.168.202.41@tcp:256:mount.lustre.0 Request processed in 3090us (3812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784837.733168:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00100000:2.0:1787784837.735953:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784837.736106:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728108544 00000100:00100000:3.0:1787784837.736116:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728108544 00000100:00100000:3.0:1787784837.736174:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 141 00000100:00100000:3.0:1787784837.736182:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:15036:x1874627728108544:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787784837.736209:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784837.736232:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c0031c00/0x88ace7295d9e3e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72e4b expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784837.736276:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c0031c00/0x88ace7295d9e3e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e4b expref: 13 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784837.736290:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c0031c00/0x88ace7295d9e3e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e4b expref: 13 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784837.736302:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0031c00, rc 0) 00000100:00100000:3.0:1787784837.736372:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:15036:x1874627728108544:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 191us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784837.736397:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 141 00000100:00100000:1.0:1787784837.741749:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784837.742048:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728108672 00000100:00100000:0.0:1787784837.742062:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728108672 00000100:00100000:0.0:1787784837.742182:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:0.0:1787784837.742207:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:15036:x1874627728108672:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787784837.742456:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:15036:x1874627728108672:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 251us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784837.742465:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:2.0:1787784837.745138:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784837.745528:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728108800 00000100:00100000:0.0:1787784837.745553:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728108800 00000100:00100000:0.0:1787784837.745644:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:0.0:1787784837.745683:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:15036:x1874627728108800:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787784837.745927:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:15036:x1874627728108800:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 248us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784837.746139:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:2.0:1787784837.752059:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784837.753130:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728108928 00000100:00100000:0.0:1787784837.753148:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728108928 00000100:00100000:0.0:1787784837.753474:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 144 00000100:00100000:0.0:1787784837.753488:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:15046:x1874627728108928:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784837.753728:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:15046:x1874627728108928:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 242us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784837.753737:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 144 00000100:00100000:2.0:1787784837.769372:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784837.769438:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728109056 00000100:00100000:0.0:1787784837.769452:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728109056 00000100:00100000:0.0:1787784837.769534:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00100000:0.0:1787784837.769555:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:15046:x1874627728109056:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784837.769794:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:15046:x1874627728109056:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 243us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784837.769803:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00100000:2.0:1787784837.789486:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784837.789541:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784837.790137:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728109184 00000100:00100000:0.0:1787784837.790151:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728109184 00000100:00100000:0.0:1787784837.790216:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728109440 00000100:00100000:0.0:1787784837.790220:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728109440 00000100:00100000:0.0:1787784837.790253:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1787784837.790264:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2404:x1874627728109184:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787784837.790308:0:17108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e18bf9c7-fc9c-4760-9682-7ca1091799a6@192.168.202.41@tcp t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:0.0:1787784837.790385:0:17108:0:(genops.c:1385:class_connect()) connect: client e18bf9c7-fc9c-4760-9682-7ca1091799a6, cookie 0x88ace7295d9e3eb 00000004:00100000:0.0:1787784837.790425:0:17108:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787784837.790563:0:17108:0:(import.c:65:import_set_state_nolock()) ffff8950c2728000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784837.790663:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2404:x1874627728109184:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 398us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784837.790672:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1787784837.790694:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:0.0:1787784837.790699:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2404:x1874627728109440:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787784837.790718:0:17108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from e18bf9c7-fc9c-4760-9682-7ca1091799a6@192.168.202.41@tcp t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:0.0:1787784837.790745:0:17108:0:(genops.c:1385:class_connect()) connect: client e18bf9c7-fc9c-4760-9682-7ca1091799a6, cookie 0x88ace7295d9e3f2 00000004:00100000:0.0:1787784837.790759:0:17108:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787784837.790863:0:17108:0:(import.c:65:import_set_state_nolock()) ffff8950c272e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784837.795251:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2404:x1874627728109440:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 4530us (5689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784837.795279:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:2.0:1787784837.805283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784837.805332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784837.805474:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784837.820929:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728109696 00000100:00100000:1.0:1787784837.820959:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728109696 00000100:00100000:1.0:1787784837.821084:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728109312 00000100:00100000:1.0:1787784837.821108:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728109312 00000100:00100000:1.0:1787784837.821128:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728109568 00000100:00100000:1.0:1787784837.821131:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728109568 00000100:00100000:1.0:1787784837.821161:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:1.0:1787784837.821172:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+7:15036:x1874627728109696:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787784837.821267:0:17107:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787784837.821409:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+7:15036:x1874627728109696:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 238us (16152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784837.821419:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:1.0:1787784837.821443:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:1.0:1787784837.821451:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:0:x1874627728109312:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787784837.821463:0:17107:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787784837.821489:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:0:x1874627728109312:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 39us (16156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784837.821496:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:1.0:1787784837.821511:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:1.0:1787784837.821518:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3575e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:0:x1874627728109568:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787784837.821538:0:17107:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:2.0:1787784837.823357:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784837.823369:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784837.826068:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3575e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:0:x1874627728109568:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 2656us (18700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784837.826094:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:2.0:1787784837.842498:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784837.842678:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728109824 00000100:00100000:0.0:1787784837.842691:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728109824 00000100:00100000:0.0:1787784837.842809:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:0.0:1787784837.842823:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:15036:x1874627728109824:12345-192.168.202.41@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787784837.843026:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:15036:x1874627728109824:12345-192.168.202.41@tcp:40:mount.lustre.0 Request processed in 206us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784837.843035:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:2.0:1787784837.852258:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784837.852305:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784837.852356:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784837.852687:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728109952 00000100:00100000:3.0:1787784837.852706:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728109952 00000100:00100000:3.0:1787784837.852799:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728110080 00000100:00100000:3.0:1787784837.852803:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728110080 00000100:00100000:3.0:1787784837.852833:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:3.0:1787784837.852846:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3577c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2404:x1874627728109952:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787784837.852925:0:18612:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e18bf9c7-fc9c-4760-9682-7ca1091799a6@192.168.202.41@tcp t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:3.0:1787784837.852983:0:18612:0:(genops.c:1385:class_connect()) connect: client e18bf9c7-fc9c-4760-9682-7ca1091799a6, cookie 0x88ace7295d9e3f9 00002000:00100000:3.0:1787784837.853000:0:18612:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e18bf9c7-fc9c-4760-9682-7ca1091799a6/ffff8951ff091000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787784837.853014:0:18612:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787784837.853298:0:18612:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787784837.853342:0:18612:0:(import.c:65:import_set_state_nolock()) ffff8951ff091800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784837.853599:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3577c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2404:x1874627728109952:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 695us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784837.853610:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:3.0:1787784837.853635:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:3.0:1787784837.853645:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3576d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2404:x1874627728110080:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787784837.853672:0:18612:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e18bf9c7-fc9c-4760-9682-7ca1091799a6@192.168.202.41@tcp t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:3.0:1787784837.853693:0:18612:0:(genops.c:1385:class_connect()) connect: client e18bf9c7-fc9c-4760-9682-7ca1091799a6, cookie 0x88ace7295d9e400 00002000:00100000:3.0:1787784837.853909:0:18612:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e18bf9c7-fc9c-4760-9682-7ca1091799a6/ffff8951ff094800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787784837.853929:0:18612:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787784837.854059:0:18612:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787784837.856736:0:18612:0:(import.c:65:import_set_state_nolock()) ffff8951ff092800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784837.857149:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728110208 00000100:00100000:0.0:1787784837.857164:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728110208 00000100:00100000:0.0:1787784837.857269:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:0.0:1787784837.857301:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3576940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:15036:x1874627728110208:12345-192.168.202.41@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787784837.860333:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3576d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2404:x1874627728110080:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 6673us (7966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784837.860354:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:1.0:1787784837.861976:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3576940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:15036:x1874627728110208:12345-192.168.202.41@tcp:900:mount.lustre.0 Request processed in 4654us (9719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784837.861992:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:2.0:1787784837.866284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784837.866537:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728110336 00000100:00100000:1.0:1787784837.866570:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728110336 00000100:00100000:1.0:1787784837.866695:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:1.0:1787784837.866709:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:15036:x1874627728110336:12345-192.168.202.41@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787784837.866870:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787784837.867121:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:15036:x1874627728110336:12345-192.168.202.41@tcp:33:mount.lustre.0 Request processed in 414us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784837.867131:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:2.0:1787784838.082837:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784838.083070:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728110464 00000100:00100000:1.0:1787784838.083083:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728110464 00000100:00100000:1.0:1787784838.083163:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1787784838.083176:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:15069:x1874627728110464:12345-192.168.202.41@tcp:101:mkdir.0 00010000:00010000:1.0:1787784838.083203:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784838.083234:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9e407 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72e7c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784838.083580:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e40e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784838.083599:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e40e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784838.083620:0:17107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e40e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784838.083680:0:17107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787784838.083685:0:17107:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787784838.083713:0:17107:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e40e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784838.083747:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9e407 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e7c expref: 8 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784838.084016:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e40e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e7c expref: 7 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784838.084026:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f512c600) 00010000:00010000:1.0:1787784838.084029:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784838.084033:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602e00, rc 0) 00000100:00100000:1.0:1787784838.084182:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+7:15069:x1874627728110464:12345-192.168.202.41@tcp:101:mkdir.0 Request processed in 1008us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784838.084191:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00010000:00010000:0.0:1787784838.217860:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784839.240372:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784839.312137:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750213120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787784839.312253:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784839.312519:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750213120 00000100:00100000:3.0:1787784839.312541:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750213120 00000100:00100000:3.0:1787784839.312642:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784839.312654:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750213120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787784839.312691:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787784839.312948:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750213120:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787784839.314280:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784839.315172:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750213120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2511us (2911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784839.315189:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784839.814672:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750213248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784839.814800:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784839.815046:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750213248 00000100:00100000:1.0:1787784839.815058:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750213248 00000100:00100000:1.0:1787784839.815134:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787784839.815147:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750213248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787784839.815194:0:17112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787784839.815249:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750213248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784839.815257:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787784839.815340:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750213248:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787784840.006644:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784840.281351:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784840.327133:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784840.327169:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750213376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784840.327290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784840.327386:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750213376 00000100:00100000:3.0:1787784840.327397:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750213376 00000100:00100000:3.0:1787784840.327474:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784840.327486:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5316580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750213376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784840.327529:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787784840.327585:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5316580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750213376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784840.327594:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787784840.327622:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784840.328371:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750213376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784840.335510:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784840.335548:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750213504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784840.335929:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784840.336506:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750213504 00000100:00100000:2.0:1787784840.336519:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750213504 00000100:00100000:2.0:1787784840.336603:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787784840.336617:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750213504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784840.336697:0:17623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787784840.336999:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750213504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 384us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784840.337009:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787784840.341748:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750213504:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1787784840.843119:0:18609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e18bf9c7-fc9c-4760-9682-7ca1091799a6 00000001:00100000:1.0:1787784840.843139:0:18609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41f7da42-7119-46f9-b18b-692347fcebc0 00000001:00100000:1.0:1787784840.845292:0:17840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e18bf9c7-fc9c-4760-9682-7ca1091799a6 00000001:00100000:1.0:1787784840.845325:0:17840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 41f7da42-7119-46f9-b18b-692347fcebc0 00000001:00100000:3.0:1787784840.846394:0:17087:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e18bf9c7-fc9c-4760-9682-7ca1091799a6 00000001:00100000:3.0:1787784840.846419:0:17087:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41f7da42-7119-46f9-b18b-692347fcebc0 00010000:00010000:0.0:1787784841.286593:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784841.350118:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784841.350152:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2663c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750213632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784841.350276:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784841.350913:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750213760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784841.350967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784841.351071:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750213632 00000100:00100000:0.0:1787784841.351083:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750213632 00000100:00100000:0.0:1787784841.351159:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750213760 00000100:00100000:0.0:1787784841.351163:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750213760 00000100:00100000:0.0:1787784841.351187:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787784841.351198:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2662940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750213632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784841.351240:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787784841.351316:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2662940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750213632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784841.351325:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787784841.351345:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784841.351352:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3574780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750213760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787784841.351363:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787784841.351391:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3574780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750213760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784841.351398:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784841.351449:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750213760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784841.351507:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1787784841.351524:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2663c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750213632:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787784841.351659:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784841.352502:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750214144:0@lo:400:kworker.0 00000100:00100000:3.0:1787784841.352578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784841.352613:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750214656:0@lo:400:kworker.0 00000100:00100000:2.0:1787784841.352809:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750214016:0@lo:400:kworker.0 00000100:00100000:2.0:1787784841.352849:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784841.352892:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750214528:0@lo:400:kworker.0 00000100:00100000:2.0:1787784841.352916:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784841.352932:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750215040:0@lo:400:kworker.0 00000100:00100000:2.0:1787784841.352962:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784841.353007:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750215040 00000100:00100000:2.0:1787784841.353015:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750215040 00000100:00100000:2.0:1787784841.353077:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787784841.353088:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2361680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750215040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784841.353141:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2361680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750215040:12345-0@lo:400:kworker.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784841.353149:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1787784841.353170:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784841.353210:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750215040:0@lo:400:kworker.0 00000100:00100000:2.0:1787784841.353252:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750214144 00000100:00100000:2.0:1787784841.353256:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750214144 00000100:00100000:2.0:1787784841.353294:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750214528 00000100:00100000:2.0:1787784841.353297:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750214528 00000100:00100000:2.0:1787784841.353343:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784841.353350:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750214144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784841.353384:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750214144:12345-0@lo:400:kworker.0 Request processed in 35us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784841.353391:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784841.353403:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784841.353409:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2362580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750214528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784841.353441:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2362580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750214528:12345-0@lo:400:kworker.0 Request processed in 33us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784841.353448:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787784841.353467:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784841.353486:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750214528:0@lo:400:kworker.0 00000100:00100000:3.0:1787784841.353823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784841.353873:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750215168:0@lo:400:kworker.0 00000100:00100000:3.0:1787784841.353911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784841.353946:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750214144:0@lo:400:kworker.0 00000100:00100000:1.0:1787784841.354042:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750213888:0@lo:400:kworker.0 00000100:00100000:1.0:1787784841.354082:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784841.354124:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750214400:0@lo:400:kworker.0 00000100:00100000:1.0:1787784841.354150:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784841.354169:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750214912:0@lo:400:kworker.0 00000100:00100000:1.0:1787784841.354189:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784841.354219:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787784841.354227:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5316940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750214272:0@lo:400:kworker.0 00000100:00100000:1.0:1787784841.354253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784841.354266:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750214784:0@lo:400:kworker.0 00000100:00100000:1.0:1787784841.354301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784841.354330:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750214016 00000100:00100000:1.0:1787784841.354336:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750214016 00000100:00100000:1.0:1787784841.354377:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750214400 00000100:00100000:1.0:1787784841.354380:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750214400 00000100:00100000:1.0:1787784841.354396:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787784841.354404:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750214016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784841.354454:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750214016:12345-0@lo:400:kworker.0 Request processed in 51us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784841.354462:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787784841.354478:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787784841.354484:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750214400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784841.354532:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750214400:12345-0@lo:400:kworker.0 Request processed in 48us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784841.354539:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787784841.354572:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750214400:0@lo:400:kworker.0 00000100:00100000:0.0:1787784841.355416:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750214656 00000100:00100000:0.0:1787784841.355425:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750214656 00000100:00100000:0.0:1787784841.355473:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750215168 00000100:00100000:0.0:1787784841.355476:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750215168 00000100:00100000:0.0:1787784841.355511:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750214912 00000100:00100000:0.0:1787784841.355514:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750214912 00000100:00100000:0.0:1787784841.355527:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750214272 00000100:00100000:0.0:1787784841.355530:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750214272 00000100:00100000:0.0:1787784841.355540:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750214784 00000100:00100000:0.0:1787784841.355543:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750214784 00000100:00100000:0.0:1787784841.355561:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784841.355569:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750214656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784841.355711:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750214656:12345-0@lo:400:kworker.0 Request processed in 143us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784841.355718:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784841.355733:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787784841.355739:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750215168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784841.355798:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750215168:12345-0@lo:400:kworker.0 Request processed in 29us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784841.355805:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787784841.355816:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787784841.355822:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c26621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750214912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784841.355852:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c26621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750214912:12345-0@lo:400:kworker.0 Request processed in 31us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784841.355871:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787784841.355896:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787784841.355902:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2663c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750214272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784841.355930:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2663c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750214272:12345-0@lo:400:kworker.0 Request processed in 29us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784841.355936:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787784841.355946:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787784841.355951:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750214784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784841.355976:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750214784:12345-0@lo:400:kworker.0 Request processed in 25us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784841.355981:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787784841.356385:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784841.356391:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787784841.356431:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5316940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750214272:0@lo:400:kworker.0 00000100:00100000:1.0:1787784841.356446:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750214784:0@lo:400:kworker.0 00010000:00080000:1.0:1787784841.356462:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f5315e00 x1874627750214912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784841.356475:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750214912:0@lo:400:kworker.0 00000100:00100000:3.0:1787784841.356952:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750213888 00000100:00100000:3.0:1787784841.356960:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750213888 00000100:00100000:3.0:1787784841.357023:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787784841.357032:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3647:x1874627750213888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784841.357103:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3647:x1874627750213888:12345-0@lo:400:kworker.0 Request processed in 72us (3020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784841.357112:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787784841.357167:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750214656:0@lo:400:kworker.0 00010000:00080000:3.0:1787784841.357184:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53161c0 x1874627750215168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784841.357196:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750215168:0@lo:400:kworker.0 00000100:00100000:1.0:1787784841.357402:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750213888:0@lo:400:kworker.0 00000100:00100000:2.0:1787784841.357592:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750214016:0@lo:400:kworker.0 00010000:00010000:0.0:1787784842.314476:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787784842.456807:0:19985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787784843.044084:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784843.044139:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784843.044183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784843.044217:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784843.044250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784843.044272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784843.044294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784843.044312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784843.044332:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728111104 00000100:00100000:2.0:1787784843.044338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784843.044346:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728111104 00000100:00100000:2.0:1787784843.044364:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728110848 00000100:00100000:2.0:1787784843.044367:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728110848 00000100:00100000:2.0:1787784843.044420:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728111360 00000100:00100000:1.0:1787784843.044420:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728111616 00000100:00100000:2.0:1787784843.044422:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728111360 00000100:00100000:1.0:1787784843.044422:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728111616 00000100:00100000:2.0:1787784843.044436:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728110720 00000100:00100000:1.0:1787784843.044436:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728110976 00000100:00100000:1.0:1787784843.044438:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728110976 00000100:00100000:1.0:1787784843.044454:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728111488 00000100:00100000:2.0:1787784843.044456:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728110720 00000100:00100000:1.0:1787784843.044456:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728111488 00000100:00100000:2.0:1787784843.044471:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728111232 00000100:00100000:2.0:1787784843.044473:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728111232 00000100:00100000:1.0:1787784843.044473:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:1.0:1787784843.044484:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c4558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:2405:x1874627728111104:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784843.044486:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:2.0:1787784843.044501:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+5:2405:x1874627728110848:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784843.044600:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728110592 00000100:00100000:3.0:1787784843.044605:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728110592 00000100:00100000:3.0:1787784843.044641:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00100000:3.0:1787784843.044648:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:2405:x1874627728110592:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784843.044732:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:0.0:1787784843.044743:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2405:x1874627728111360:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784843.045349:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+5:2405:x1874627728110848:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 853us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784843.045358:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:2.0:1787784843.045384:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:2.0:1787784843.045392:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+6:2405:x1874627728110720:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784843.055253:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c4558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:2405:x1874627728111104:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 10747us (11045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784843.055283:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:1.0:1787784843.055556:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:1.0:1787784843.055575:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2362940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2405:x1874627728111616:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784843.055645:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2362940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2405:x1874627728111616:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 78us (11394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784843.055651:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:1.0:1787784843.055663:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:1.0:1787784843.055671:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:2405:x1874627728110976:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784843.055695:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:2405:x1874627728110976:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (11400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784843.055701:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:1.0:1787784843.055723:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:1.0:1787784843.055731:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2360f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2405:x1874627728111488:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784843.055788:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2405:x1874627728111488:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 37us (11428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784843.055795:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00080000:1.0:1787784843.055825:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784843.055833:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787784843.055854:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784843.055858:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784843.055922:0:17108:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787784843.055933:0:17108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787784843.055965:0:18636:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787784843.055976:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:1.0:1787784843.055985:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2405:x1874627728111232:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784843.056020:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2405:x1874627728111232:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 36us (11706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784843.056034:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:3.0:1787784843.056068:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:2405:x1874627728110592:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 11418us (12000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784843.056084:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00100000:0.0:1787784843.065076:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2405:x1874627728111360:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 20310us (20832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784843.065098:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:2.0:1787784843.066123:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+6:2405:x1874627728110720:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 20720us (21837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784843.066136:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00010000:00010000:3.0:1787784843.334303:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787784843.922718:0:19429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e18bf9c7-fc9c-4760-9682-7ca1091799a6 00010000:00010000:3.0:1787784844.358605:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784844.422293:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750215296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784844.422383:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784844.422839:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750215296 00000100:00100000:0.0:1787784844.422849:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750215296 00000100:00100000:0.0:1787784844.422967:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784844.422977:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2363840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750215296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784844.423007:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787784844.423060:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2363840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750215296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784844.423067:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787784844.423140:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750215296:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787784844.423197:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784844.934374:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750215424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784844.934449:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784844.934529:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750215424 00000100:00100000:1.0:1787784844.934537:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750215424 00000100:00100000:1.0:1787784844.934598:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787784844.934608:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750215424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787784844.934646:0:17112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787784844.934696:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750215424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784844.934705:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787784844.934748:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750215424:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784845.382157:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784845.446086:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750215552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784845.446180:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784845.446319:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750215552 00000100:00100000:3.0:1787784845.446329:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750215552 00000100:00100000:3.0:1787784845.446403:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787784845.446415:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2361e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750215552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784845.446448:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787784845.446507:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2361e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750215552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784845.446515:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787784845.446575:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750215552:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787784845.446736:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784845.447193:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784845.447205:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750215680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784845.447242:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784845.447415:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750215680 00000100:00100000:3.0:1787784845.447421:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750215680 00000100:00100000:3.0:1787784845.447452:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787784845.447459:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750215680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787784845.447485:0:17623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787784845.447533:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750215680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784845.447541:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787784845.447696:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750215680:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1787784846.201417:0:20134:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe09aa8880 20000000:00000080:2.0:1787784846.201617:0:20134:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff895201c82400 uarg=0000000000000000 20000000:01000000:2.0:1787784846.201670:0:20134:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787784846.201754:0:20134:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787784846.201760:0:20134:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787784846.202478:0:20135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787784846.203559:0:20134:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787784846.212132:0:20134:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787784846.212354:0:20134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.212376:0:20134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8950c3712c00/0x88ace7295d9e0aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e0a3 expref: 23 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.212385:0:20134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8950c4183600/0x88ace7295d9e0b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e0b1 expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.212393:0:20134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8950c3712400/0x88ace7295d9e0f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e0f0 expref: 23 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.212400:0:20134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951df603600/0x88ace7295d9e255 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e24e expref: 23 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.212422:0:20134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951df602400/0x88ace7295d9e3a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ddb expref: 12 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.212430:0:20134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c0031c00/0x88ace7295d9e3e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e4b expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.212438:0:20134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.212550:0:20134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c0031c00/0x88ace7295d9e3e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e4b expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.212567:0:20134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951c0031c00/0x88ace7295d9e3e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e4b expref: 12 pid: 17102 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784846.212584:0:20134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1874627750215808:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784846.212899:0:20134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951df602400/0x88ace7295d9e3a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ddb expref: 12 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.212909:0:20134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951df602400/0x88ace7295d9e3a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ddb expref: 12 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784846.212918:0:20134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1874627750215936:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784846.212950:0:20134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951df603600/0x88ace7295d9e255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e24e expref: 23 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.212958:0:20134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951df603600/0x88ace7295d9e255 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e24e expref: 23 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784846.212979:0:20134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1874627750216064:0@lo:104: 00000100:00100000:1.0:1787784846.213024:0:20134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784846.213065:0:20134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8950c3712400/0x88ace7295d9e0f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e0f0 expref: 23 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.213072:0:20134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8950c3712400/0x88ace7295d9e0f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e0f0 expref: 23 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784846.213080:0:20134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1874627750216192:0@lo:104: 00000100:00100000:1.0:1787784846.213100:0:20134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784846.213131:0:20134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8950c4183600/0x88ace7295d9e0b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e0b1 expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.213139:0:20134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8950c4183600/0x88ace7295d9e0b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e0b1 expref: 23 pid: 17102 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784846.213148:0:20134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1874627750216320:0@lo:104: 00000100:00100000:1.0:1787784846.213167:0:20134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784846.213182:0:20134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8950c3712c00/0x88ace7295d9e0aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e0a3 expref: 23 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.213189:0:20134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8950c3712c00/0x88ace7295d9e0aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e0a3 expref: 23 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784846.213196:0:20134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1874627750216448:0@lo:104: 00000100:00100000:1.0:1787784846.213213:0:20134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784846.213222:0:20134:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66df00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784846.213429:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750216064 00000100:00100000:2.0:1787784846.213436:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750216064 00000100:00100000:2.0:1787784846.213489:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750216192 00000100:00100000:2.0:1787784846.213492:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750216192 00000100:00100000:2.0:1787784846.213504:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750216320 00000100:00100000:2.0:1787784846.213506:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750216320 00000100:00100000:2.0:1787784846.213515:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750216448 00000100:00100000:2.0:1787784846.213517:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750216448 00000100:00100000:2.0:1787784846.213530:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787784846.213538:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+6:20134:x1874627750216064:12345-0@lo:104: 00010000:00010000:2.0:1787784846.213550:0:17090:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e255 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.213616:0:17090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784846.213622:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+6:20134:x1874627750216064:12345-0@lo:104: Request processed in 85us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784846.213629:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787784846.213647:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784846.213653:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5292d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+5:20134:x1874627750216192:12345-0@lo:104: 00010000:00010000:2.0:1787784846.213660:0:17090:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e0f7 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.213887:0:17090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787784846.213893:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5292d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+5:20134:x1874627750216192:12345-0@lo:104: Request processed in 240us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784846.213900:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784846.213914:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784846.213930:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+4:20134:x1874627750216320:12345-0@lo:104: 00010000:00010000:2.0:1787784846.213937:0:17090:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e0b8 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.213971:0:17090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787784846.213976:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+4:20134:x1874627750216320:12345-0@lo:104: Request processed in 48us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784846.213982:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784846.213995:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784846.214001:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+3:20134:x1874627750216448:12345-0@lo:104: 00010000:00010000:2.0:1787784846.214008:0:17090:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e0aa expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.214032:0:17090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787784846.214036:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+3:20134:x1874627750216448:12345-0@lo:104: Request processed in 37us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784846.214042:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787784846.214058:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787784846.214063:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e255 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.214070:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784846.214074:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e255 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.214082:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e255 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784846.214089:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e255 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784846.214102:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787784846.214132:0:17096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e255 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.214139:0:17096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784846.214159:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e255 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.214166:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c4183000/0x88ace7295d9e24e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e255 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.214178:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787784846.214181:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e0f7 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.214186:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629c00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784846.214189:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e0f7 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.214196:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e0f7 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784846.214202:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e0f7 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784846.214207:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787784846.214219:0:17096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e0f7 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.214225:0:17096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784846.214239:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e0f7 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.214245:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1629c00/0x88ace7295d9e0f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e0f7 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.214255:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784846.214258:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e0b8 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.214263:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713200 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784846.214266:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e0b8 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784846.214424:0:20134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1874627750216064:0@lo:104: 00000100:00100000:1.0:1787784846.214442:0:20134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1874627750216192:0@lo:104: 00000100:00100000:1.0:1787784846.214449:0:20134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1874627750216320:0@lo:104: 00000100:00100000:1.0:1787784846.214455:0:20134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1874627750216448:0@lo:104: 00010000:00010000:2.0:1787784846.214632:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e0b8 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784846.214640:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e0b8 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784846.214645:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787784846.214660:0:17096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e0b8 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.214666:0:17096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787784846.214717:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2361a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750216832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784846.214783:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784846.215046:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750216832 00000100:00100000:1.0:1787784846.215051:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750216832 00010000:00010000:1.0:1787784846.215075:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8950c4183600/0x88ace7295d9e0b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e0b1 expref: 24 pid: 17102 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784846.215103:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784846.215114:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3644:x1874627750216832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784846.215125:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784846.215130:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8950c4183600/0x88ace7295d9e0b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e0b1 expref: 24 pid: 17102 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.215140:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8950c4183600/0x88ace7295d9e0b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e0b1 expref: 24 pid: 17102 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.215154:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c4183600/0x88ace7295d9e0b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e0b1 expref: 24 pid: 17102 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.215166:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784846.215447:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e0b8 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.215456:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c3713200/0x88ace7295d9e0b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e0b8 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.215470:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784846.215481:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e0aa expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.215487:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183a00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784846.215490:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e0aa expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.215496:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e0aa expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784846.215501:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e0aa expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784846.215506:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787784846.215520:0:17096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e0aa expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.215526:0:17096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787784846.215567:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750216960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784846.215594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784846.215631:0:17092:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787784846.215639:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787784846.215826:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750216576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784846.215850:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784846.215868:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784846.215874:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750216704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784846.215892:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784846.215914:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784846.215920:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784846.215926:0:17093:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787784846.215932:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750216960 00000100:00100000:0.0:1787784846.215936:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750216960 00010000:00010000:0.0:1787784846.215952:0:17093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8950c3712c00/0x88ace7295d9e0aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e0a3 expref: 24 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784846.215966:0:17093:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787784846.215971:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750216576 00000100:00100000:0.0:1787784846.215973:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750216576 00010000:00010000:0.0:1787784846.215983:0:17093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951df603600/0x88ace7295d9e255 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e24e expref: 25 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784846.215992:0:17093:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787784846.215996:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750216704 00000100:00100000:0.0:1787784846.215999:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750216704 00010000:00010000:0.0:1787784846.216008:0:17093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8950c3712400/0x88ace7295d9e0f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e0f0 expref: 26 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784846.216031:0:17093:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787784846.216037:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784846.216044:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+26:3645:x1874627750216960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784846.216052:0:17093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784846.216056:0:17093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8950c3712c00/0x88ace7295d9e0aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e0a3 expref: 26 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784846.216063:0:17093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8950c3712c00/0x88ace7295d9e0aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e0a3 expref: 26 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784846.216075:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3712c00/0x88ace7295d9e0aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e0a3 expref: 26 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784846.216085:0:17093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784846.216111:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+25:3645:x1874627750216960:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784846.216117:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784846.216129:0:17093:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787784846.216135:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784846.216140:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3646:x1874627750216576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784846.216147:0:17093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784846.216150:0:17093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951df603600/0x88ace7295d9e255 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e24e expref: 24 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784846.216157:0:17093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951df603600/0x88ace7295d9e255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e24e expref: 24 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784846.216166:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df603600/0x88ace7295d9e255 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e24e expref: 24 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784846.216179:0:17093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784846.216203:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:3646:x1874627750216576:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784846.216209:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784846.216219:0:17093:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787784846.216225:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784846.216230:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:3646:x1874627750216704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784846.216237:0:17093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784846.216241:0:17093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8950c3712400/0x88ace7295d9e0f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e0f0 expref: 22 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784846.216247:0:17093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8950c3712400/0x88ace7295d9e0f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e0f0 expref: 22 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784846.216256:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3712400/0x88ace7295d9e0f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e0f0 expref: 22 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784846.216264:0:17093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784846.216300:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3646:x1874627750216704:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784846.216306:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784846.216335:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750216960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784846.216357:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750216704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784846.216364:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750216576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784846.220662:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:3644:x1874627750216832:12345-0@lo:103:ldlm_bl.0 Request processed in 5536us (5882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784846.220679:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784846.222648:0:20134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1874627750215808:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784846.223551:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e0aa expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.223565:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c4183a00/0x88ace7295d9e0a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e0aa expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.223587:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784846.223589:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784846.223592:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784846.225910:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2361a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750216832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784846.226181:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784846.227090:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728111744 00000100:00100000:2.0:1787784846.227101:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728111744 00010000:00010000:2.0:1787784846.227142:0:17093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c0031c00/0x88ace7295d9e3e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e4b expref: 13 pid: 17102 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784846.227200:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:2.0:1787784846.227211:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4039c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:2406:x1874627728111744:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784846.227226:0:17093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784846.227233:0:17093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c0031c00/0x88ace7295d9e3e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e4b expref: 13 pid: 17102 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.227243:0:17093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c0031c00/0x88ace7295d9e3e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e4b expref: 13 pid: 17102 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.227404:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c0031c00/0x88ace7295d9e3e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e4b expref: 13 pid: 17102 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.227422:0:17093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784846.227489:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4039c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:2406:x1874627728111744:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 279us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784846.227497:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:1.0:1787784846.227670:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784846.228095:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728111872 00000100:00100000:1.0:1787784846.228108:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728111872 00010000:00010000:1.0:1787784846.228127:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951df602400/0x88ace7295d9e3a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ddb expref: 12 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784846.228147:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:1.0:1787784846.228155:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4165a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:2406:x1874627728111872:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784846.228164:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784846.228168:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951df602400/0x88ace7295d9e3a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ddb expref: 12 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.228177:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951df602400/0x88ace7295d9e3a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ddb expref: 12 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.228190:0:17094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.228199:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.228213:0:17094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.228220:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.228227:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.228233:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.228238:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784846.228248:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.228256:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.229403:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784846.229418:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784846.229488:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4165a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:2406:x1874627728111872:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 1331us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784846.229498:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00010000:00010000:3.0:1787784846.229946:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df602400/0x88ace7295d9e3a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ddb expref: 11 pid: 17101 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784846.229972:0:20134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1874627750215936:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784846.230007:0:20134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784846.230018:0:20134:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784846.230024:0:20134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784846.230030:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df603400/0x88ace7295d9e415 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784846.424870:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784846.469912:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784846.469938:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750217088:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470006:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784846.470064:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750217216:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784846.470135:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750217344:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470157:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784846.470202:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750217472:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470248:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784846.470308:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784846.470314:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750217600:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784846.470365:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750217088 00000100:00100000:2.0:1787784846.470372:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750217088 00000100:00100000:2.0:1787784846.470408:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750217600 00000100:00100000:2.0:1787784846.470411:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750217600 00000100:00100000:2.0:1787784846.470427:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787784846.470435:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2361a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750217088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470498:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2361a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750217088:12345-0@lo:400:kworker.0 Request processed in 62us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784846.470505:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787784846.470523:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787784846.470529:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5315680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750217600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470556:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5315680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750217600:12345-0@lo:400:kworker.0 Request processed in 27us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784846.470562:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787784846.470594:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750217600:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470604:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750217088:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470637:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750217728:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784846.470698:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750217856:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470718:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784846.470755:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750217984:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784846.470865:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784846.470871:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5316940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750218112:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470892:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784846.470927:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750218240:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.470949:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784846.470981:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750217472 00000100:00100000:2.0:1787784846.470984:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750217472 00000100:00100000:2.0:1787784846.471007:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750217984 00000100:00100000:2.0:1787784846.471009:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750217984 00000100:00100000:2.0:1787784846.471018:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750218112 00000100:00100000:2.0:1787784846.471020:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750218112 00000100:00100000:2.0:1787784846.471038:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750218240 00000100:00100000:2.0:1787784846.471040:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750218240 00000100:00100000:2.0:1787784846.471056:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787784846.471062:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750217472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.471094:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750217472:12345-0@lo:400:kworker.0 Request processed in 33us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784846.471101:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787784846.471111:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787784846.471116:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750217984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.471139:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750217984:12345-0@lo:400:kworker.0 Request processed in 22us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784846.471145:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787784846.471154:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787784846.471159:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5317c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750218112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784846.471704:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750217216 00000100:00100000:3.0:1787784846.471709:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750217216 00000100:00100000:3.0:1787784846.471731:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750217344 00000100:00100000:3.0:1787784846.471733:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750217344 00000100:00100000:3.0:1787784846.471743:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750217728 00000100:00100000:3.0:1787784846.471745:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750217728 00000100:00100000:3.0:1787784846.471756:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750217856 00000100:00100000:3.0:1787784846.471758:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750217856 00000100:00100000:3.0:1787784846.471783:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787784846.471790:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750217216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784846.471834:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750217216:12345-0@lo:400:kworker.0 Request processed in 45us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784846.471840:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787784846.471850:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784846.471855:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2362580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750217344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784846.471896:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2362580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750217344:12345-0@lo:400:kworker.0 Request processed in 41us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784846.471902:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784846.471910:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787784846.471916:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5315a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750217728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784846.471934:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5315a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750217728:12345-0@lo:400:kworker.0 Request processed in 19us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784846.471939:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787784846.471947:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787784846.471952:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750217856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784846.471969:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750217856:12345-0@lo:400:kworker.0 Request processed in 18us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784846.471975:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787784846.471989:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787784846.471995:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750218240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784846.472016:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750218240:12345-0@lo:400:kworker.0 Request processed in 22us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784846.472022:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787784846.472182:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5317c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750218112:12345-0@lo:400:kworker.0 Request processed in 1021us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784846.472195:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787784846.472222:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750218368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784846.472252:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784846.472298:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750217856:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.472307:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750217344:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.472333:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750217984:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.472343:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750217472:0@lo:400:kworker.0 00010000:00080000:2.0:1787784846.472365:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f5317480 x1874627750218240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784846.472376:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750218240:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.472384:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5316940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750218112:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.472393:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750217728:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.472404:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750217216:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.472433:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750218496:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.472452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784846.472612:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784846.472618:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750218624:0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.472641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784846.472658:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750218496 00000100:00100000:2.0:1787784846.472661:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750218496 00000100:00100000:2.0:1787784846.472682:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750218624 00000100:00100000:2.0:1787784846.472688:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750218624 00000100:00100000:2.0:1787784846.472703:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787784846.472708:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750218496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.472738:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750218496:12345-0@lo:400:kworker.0 Request processed in 30us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784846.472744:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787784846.472753:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787784846.472758:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750218624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784846.472802:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750218624:12345-0@lo:400:kworker.0 Request processed in 44us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784846.472818:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787784846.472839:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750218496:0@lo:400:kworker.0 00010000:00080000:2.0:1787784846.472855:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f5317480 x1874627750218624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784846.472865:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750218624:0@lo:400:kworker.0 00000100:00100000:3.0:1787784846.472924:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750218368 00000100:00100000:3.0:1787784846.472927:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750218368 00000100:00100000:3.0:1787784846.472955:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787784846.472961:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750218368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784846.472981:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787784846.473013:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750218368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784846.473028:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787784846.473057:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750218368:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787784846.478873:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787784846.478885:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784846.478889:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784846.478891:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784846.482672:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750218752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784846.482754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784846.482858:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750218752 00000100:00100000:3.0:1787784846.482865:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750218752 00000100:00100000:3.0:1787784846.482912:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784846.482921:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750218752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787784846.482943:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787784846.482983:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750218752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784846.482990:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784846.490570:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750218752:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1787784846.918661:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784847.436838:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787784847.558860:0:17104:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787784847.558870:0:17104:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951c7764000 from 13 10000000:01000000:0.0:1787784847.558876:0:17104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784847.558919:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.558931:0:17104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.558943:0:17104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784847.558970:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750218880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784847.559034:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784847.559151:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8844d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784847.559187:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750218880 00000100:00100000:3.0:1787784847.559194:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750218880 00000100:00100000:3.0:1787784847.559430:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787784847.559440:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:17104:x1874627750218880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784847.559452:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784847.559465:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c0031800/0x88ace7295d9e423 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e41c expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784847.559487:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c0031800/0x88ace7295d9e423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e41c expref: 21 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784847.559497:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c0031800/0x88ace7295d9e423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e41c expref: 21 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784847.559519:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0031800, rc 0) 00000100:00100000:3.0:1787784847.559558:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:17104:x1874627750218880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784847.559564:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787784847.559689:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750218880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784847.559703:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.559712:0:17104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784847.559810:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784847.559839:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784847.559853:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8844d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784847.559893:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750219008 00000100:00100000:1.0:1787784847.559898:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750219008 00000100:00100000:1.0:1787784847.559927:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787784847.559935:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c364b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:17104:x1874627750219008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784847.560036:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c364b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:17104:x1874627750219008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784847.560042:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787784847.560054:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784847.560079:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784847.560116:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784847.560149:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8844d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784847.560187:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750219136 00000100:00100000:3.0:1787784847.560191:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750219136 00000100:00100000:3.0:1787784847.560245:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787784847.560332:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:17104:x1874627750219136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784847.560451:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:17104:x1874627750219136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784847.560458:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787784847.560514:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787784847.564722:0:20203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787784847.564844:0:17104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787784847.564867:0:17104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787784847.564879:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.564890:0:17104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784847.564901:0:17104:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787784847.564904:0:17104:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951f6b92000 from 13 10000000:01000000:0.0:1787784847.564907:0:17104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784847.564940:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.564948:0:17104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.564958:0:17104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784847.564986:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784847.565060:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784847.565102:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8844d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784847.565156:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750219264 00000100:00100000:1.0:1787784847.565163:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750219264 00000100:00100000:1.0:1787784847.565206:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787784847.565214:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:17104:x1874627750219264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784847.565237:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784847.565248:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df602400/0x88ace7295d9e431 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e42a expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784847.565279:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602400/0x88ace7295d9e431 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e42a expref: 22 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784847.565289:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df602400/0x88ace7295d9e431 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e42a expref: 22 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784847.565297:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602400, rc 0) 00000100:00100000:1.0:1787784847.565387:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:17104:x1874627750219264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784847.565389:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784847.565394:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00010000:00010000:0.0:1787784847.565402:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.565418:0:17104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784847.565467:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784847.565491:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784847.565519:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8844d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784847.565650:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750219392 00000100:00100000:2.0:1787784847.565653:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750219392 00000100:00100000:0.0:1787784847.565703:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787784847.565711:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:17104:x1874627750219392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784847.565854:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:17104:x1874627750219392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784847.565861:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787784847.565888:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784847.565917:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5314f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784847.565950:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784847.565970:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784847.566000:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750219520 00000100:00100000:1.0:1787784847.566003:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750219520 00000100:00100000:1.0:1787784847.566023:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787784847.566027:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:17104:x1874627750219520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784847.566092:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:17104:x1874627750219520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784847.566099:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787784847.566121:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5314f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787784847.567095:0:20204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787784847.567202:0:17104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787784847.567217:0:17104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787784847.567224:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.567231:0:17104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784847.567238:0:17104:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787784847.567239:0:17104:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8950c4020000 from 13 10000000:01000000:0.0:1787784847.567241:0:17104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784847.567262:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.567275:0:17104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.567282:0:17104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784847.567294:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784847.567324:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784847.567355:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8844300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784847.567361:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750219648 00000100:00100000:3.0:1787784847.567366:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750219648 00000100:00100000:3.0:1787784847.567405:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787784847.567413:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+22:17104:x1874627750219648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784847.567422:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784847.567432:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c0031400/0x88ace7295d9e43f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e438 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784847.567449:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c0031400/0x88ace7295d9e43f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e438 expref: 23 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784847.567459:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c0031400/0x88ace7295d9e43f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e438 expref: 23 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784847.567467:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0031400, rc 0) 00000100:00100000:3.0:1787784847.567516:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:17104:x1874627750219648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784847.567523:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787784847.567550:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784847.567562:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.567568:0:17104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784847.567603:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784847.567620:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784847.567636:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8844300 going to sleep for 11 seconds 00000100:00100000:1.0:1787784847.567667:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750219776 00000100:00100000:1.0:1787784847.567725:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750219776 00000100:00100000:1.0:1787784847.567749:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787784847.567755:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:17104:x1874627750219776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784847.567865:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:17104:x1874627750219776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784847.567876:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787784847.567941:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784847.567959:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784847.567990:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784847.568009:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8844300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784847.568020:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750219904 00000100:00100000:3.0:1787784847.568024:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750219904 00000100:00100000:3.0:1787784847.568051:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787784847.568057:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:17104:x1874627750219904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784847.568137:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:17104:x1874627750219904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784847.568143:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787784847.568286:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750219904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787784847.569109:0:20205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787784847.569282:0:17104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787784847.569303:0:17104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787784847.569310:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.569316:0:17104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784847.569322:0:17104:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787784847.569324:0:17104:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951fb22c000 from 13 10000000:01000000:0.0:1787784847.569326:0:17104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784847.569343:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.569348:0:17104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.569354:0:17104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784847.569365:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750220032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784847.569393:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784847.569420:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8844300 going to sleep for 11 seconds 00000100:00100000:2.0:1787784847.569898:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750220032 00000100:00100000:2.0:1787784847.569904:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750220032 00000100:00100000:2.0:1787784847.569977:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787784847.569983:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:17104:x1874627750220032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784847.569992:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784847.570002:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e44d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e446 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784847.570017:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e44d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e446 expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784847.570023:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e44d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e446 expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784847.570029:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183a00, rc 0) 00000100:00100000:2.0:1787784847.570063:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:17104:x1874627750220032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784847.570067:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787784847.570112:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750220032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784847.570122:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.570128:0:17104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784847.570163:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750220160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784847.570186:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784847.571108:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8844300 going to sleep for 11 seconds 00000100:00100000:1.0:1787784847.571140:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750220160 00000100:00100000:1.0:1787784847.571144:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750220160 00000100:00100000:1.0:1787784847.571164:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787784847.571169:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:17104:x1874627750220160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784847.571290:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750220160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784847.571322:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750220288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784847.571326:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:17104:x1874627750220160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784847.571333:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787784847.571362:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784847.571379:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784847.571392:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750220288 00000100:00100000:1.0:1787784847.571396:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750220288 00000100:00100000:1.0:1787784847.571410:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787784847.571414:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:17104:x1874627750220288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784847.571481:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:17104:x1874627750220288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784847.571488:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787784847.571527:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a45ddeb3-718a-48eb-8507-e0c94319fca6:17104:1874627750220288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787784847.572252:0:20206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787784847.572329:0:17104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787784847.572351:0:17104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787784847.572360:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784847.572370:0:17104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784847.970428:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784847.972585:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728112000 00000100:00100000:0.0:1787784847.972602:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728112000 00000100:00100000:0.0:1787784847.972663:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 160 00000100:00100000:0.0:1787784847.972674:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:14918:x1874627728112000:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784847.972690:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784847.973583:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d35000/0x88ace7295d9e454 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72e83 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.973620:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d35000/0x88ace7295d9e454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e83 expref: 12 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.973633:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d35000/0x88ace7295d9e454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e83 expref: 12 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784847.973642:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35000, rc 0) 00000100:00100000:0.0:1787784847.976642:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:14918:x1874627728112000:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 1044us (3301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784847.976666:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 160 00000100:00100000:2.0:1787784847.980421:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784847.980491:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728112128 00000100:00100000:3.0:1787784847.980502:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728112128 00000100:00100000:3.0:1787784847.980566:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:3.0:1787784847.980576:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:14918:x1874627728112128:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784847.980760:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:14918:x1874627728112128:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 185us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784847.980788:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:2.0:1787784848.004386:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784848.004490:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728112256 00000100:00100000:3.0:1787784848.004509:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728112256 00000100:00100000:3.0:1787784848.004561:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:3.0:1787784848.004570:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:14918:x1874627728112256:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784848.004707:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:14918:x1874627728112256:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 137us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784848.004715:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:1.0:1787784848.017110:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784848.017264:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728112384 00000100:00100000:0.0:1787784848.017275:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728112384 00000100:00100000:0.0:1787784848.017338:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:0.0:1787784848.017350:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:14918:x1874627728112384:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784848.017369:0:17101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784848.017390:0:17101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e45b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72e8a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784848.017438:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e8a expref: 13 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784848.017451:0:17101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e8a expref: 13 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784848.017461:0:17101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35200, rc 0) 00000100:00100000:0.0:1787784848.017530:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:14918:x1874627728112384:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 182us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784848.017537:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:2.0:1787784848.023940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784848.024021:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728112512 00000100:00100000:1.0:1787784848.024031:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728112512 00000100:00100000:1.0:1787784848.024102:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:1.0:1787784848.024113:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:14918:x1874627728112512:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784848.024263:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:14918:x1874627728112512:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 141us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784848.024271:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:1.0:1787784848.035567:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784848.035635:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728112640 00000100:00100000:2.0:1787784848.035644:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728112640 00000100:00100000:2.0:1787784848.035706:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:2.0:1787784848.035717:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:14918:x1874627728112640:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784848.035895:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:14918:x1874627728112640:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 179us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784848.035903:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:1.0:1787784848.167442:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784848.167486:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784848.167522:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784848.167539:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784848.167554:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784848.167573:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784848.167591:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784848.167613:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784848.167640:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728113024 00000100:00100000:1.0:1787784848.167649:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728113024 00000100:00100000:1.0:1787784848.167701:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728113536 00000100:00100000:1.0:1787784848.167704:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728113536 00000100:00100000:1.0:1787784848.167715:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728113152 00000100:00100000:1.0:1787784848.167718:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728113152 00000100:00100000:1.0:1787784848.167728:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728113664 00000100:00100000:1.0:1787784848.167731:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728113664 00000100:00100000:1.0:1787784848.167746:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:1.0:1787784848.167756:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:2406:x1874627728113024:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784848.167863:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:2406:x1874627728113024:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 108us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784848.167872:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:1.0:1787784848.167905:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1787784848.167911:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2661a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2406:x1874627728113536:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784848.167935:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2661a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2406:x1874627728113536:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784848.167940:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1787784848.167950:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:1.0:1787784848.167955:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2661680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:2405:x1874627728113152:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784848.167975:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2661680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:2405:x1874627728113152:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 19us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784848.167981:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:1.0:1787784848.167993:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1787784848.167998:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2405:x1874627728113664:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784848.168020:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2405:x1874627728113664:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784848.168026:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1787784848.168047:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728112768 00000100:00100000:1.0:1787784848.168051:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728112768 00000100:00100000:1.0:1787784848.168079:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728112896 00000100:00100000:1.0:1787784848.168082:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728112896 00000100:00100000:1.0:1787784848.168092:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728113280 00000100:00100000:1.0:1787784848.168094:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728113280 00000100:00100000:1.0:1787784848.168104:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728113408 00000100:00100000:1.0:1787784848.168106:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728113408 00000100:00100000:1.0:1787784848.168118:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:1.0:1787784848.168124:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c41670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+6:2406:x1874627728112768:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784848.168169:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c41670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+6:2406:x1874627728112768:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 45us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784848.168184:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:1.0:1787784848.168197:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:1.0:1787784848.168203:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4164f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+5:2405:x1874627728112896:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784848.168235:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4164f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+5:2405:x1874627728112896:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 32us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784848.168241:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:1.0:1787784848.168250:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:1.0:1787784848.168256:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2406:x1874627728113280:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784848.168276:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2406:x1874627728113280:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 20us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784848.168281:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:1.0:1787784848.168291:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:1.0:1787784848.168297:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2660f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2405:x1874627728113408:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784848.168318:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2660f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2405:x1874627728113408:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784848.168323:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00080000:1.0:1787784848.168342:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784848.168346:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784848.168348:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784848.168351:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787784848.454984:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784849.478247:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784849.543198:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784849.543222:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750220416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784849.543289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784849.543564:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750220416 00000100:00100000:0.0:1787784849.543572:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750220416 00000100:00100000:0.0:1787784849.543640:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787784849.543651:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750220416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784849.543693:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787784849.543749:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750220416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784849.543757:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784849.543934:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750220416:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787784849.549241:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784849.964727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784849.964887:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728113792 00000100:00100000:1.0:1787784849.964899:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728113792 00000100:00100000:1.0:1787784849.964978:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:1.0:1787784849.964990:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+6:15585:x1874627728113792:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784849.965033:0:18636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784849.965059:0:18636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9e462 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72e91 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965135:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9e469 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965149:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9e469 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965160:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9e469 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965171:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9e470 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965177:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9e470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965183:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9e470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965272:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9e477 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965276:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9e477 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965281:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9e477 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784849.965310:0:18636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787784849.965317:0:18636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787784849.965358:0:18636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9e477 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965368:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9e469 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965373:0:18636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9e469 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965379:0:18636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9e469 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965386:0:18636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784849.965391:0:18636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9e469 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965400:0:18636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9e469 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965414:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f512c600) 00010000:00010000:1.0:1787784849.965417:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784849.965422:0:18636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9e469 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965756:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9e469 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965821:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9e470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965827:0:18636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9e470 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965845:0:18636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9e470 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965850:0:18636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784849.965853:0:18636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9e470 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965858:0:18636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9e470 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965867:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8950c3351500) 00010000:00010000:1.0:1787784849.965869:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784849.965872:0:18636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9e470 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965878:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603a00/0x88ace7295d9e470 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965916:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602800/0x88ace7295d9e462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e91 expref: 8 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965928:0:18636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9e477 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e91 expref: 7 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784849.965937:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8950c3351600) 00010000:00010000:1.0:1787784849.965938:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784849.965940:0:18636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602000, rc 0) 00000100:00100000:1.0:1787784849.966079:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+7:15585:x1874627728113792:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1091us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784849.966093:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:1.0:1787784849.974728:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784849.974842:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728113920 00000100:00100000:3.0:1787784849.974858:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728113920 00000100:00100000:3.0:1787784849.974932:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:3.0:1787784849.974945:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41f7da42-7119-46f9-b18b-692347fcebc0+7:15585:x1874627728113920:12345-192.168.202.41@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787784849.975063:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41f7da42-7119-46f9-b18b-692347fcebc0+7:15585:x1874627728113920:12345-192.168.202.41@tcp:900:lhsmtool_posix.0 Request processed in 120us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784849.975073:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:3.0:1787784849.985080:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784849.985222:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728114176 00000100:00100000:2.0:1787784849.985235:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728114176 00000100:00100000:2.0:1787784849.985320:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:2.0:1787784849.985332:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+7:15585:x1874627728114176:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784849.985359:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784849.985390:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9e47e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72e98 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.985498:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e485 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.985517:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e485 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.985530:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e485 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.989681:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e48c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.989711:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e48c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.989725:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e48c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.990751:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9e493 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.990808:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9e493 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.990820:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9e493 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784849.990834:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787784849.991023:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e485 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.991032:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e485 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.991038:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e485 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.991044:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784849.991048:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e485 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.991055:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e485 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.991069:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8950c3351600) 00010000:00010000:2.0:1787784849.991072:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784849.991077:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e485 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.991092:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e485 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.991108:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e48c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.991114:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e48c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.991120:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e48c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.991125:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784849.991128:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e48c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.991135:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e48c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.991143:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8951fa991600) 00010000:00010000:2.0:1787784849.991145:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784849.991148:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e48c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.991154:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e48c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.993890:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9e47e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e98 expref: 10 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.993918:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9e493 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e98 expref: 9 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784849.993941:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951fa991300) 00010000:00010000:2.0:1787784849.993944:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784849.993947:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183400, rc 0) 00000100:00100000:2.0:1787784849.994704:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+9:15585:x1874627728114176:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 9370us (9637us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787784849.994716:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:0.0:1787784850.008013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784850.008737:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728114304 00000100:00100000:3.0:1787784850.008750:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728114304 00000100:00100000:3.0:1787784850.008900:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:3.0:1787784850.008912:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+9:15585:x1874627728114304:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787784850.009045:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+9:15585:x1874627728114304:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 136us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784850.009053:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00080000:1.0:1787784850.009943:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784850.022173:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784850.023873:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728114432 00000100:00100000:2.0:1787784850.023889:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728114432 00000100:00100000:2.0:1787784850.023979:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:2.0:1787784850.023995:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:15585:x1874627728114432:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1787784850.024008:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787784850.025702:0:17108:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1654us 00000100:00100000:1.0:1787784850.054105:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784850.055980:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750220544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784850.056064:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784850.060749:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750220544 00000100:00100000:3.0:1787784850.060917:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750220544 00000100:00100000:3.0:1787784850.061137:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787784850.061150:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750220544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784850.061190:0:17623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787784850.061295:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750220544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (5230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784850.061303:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787784850.061398:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750220544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784850.087402:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:15585:x1874627728114432:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 63399us (65230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784850.087422:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:0.0:1787784850.099086:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784850.099740:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728114560 00000100:00100000:2.0:1787784850.099753:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728114560 00000100:00100000:2.0:1787784850.100037:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:2.0:1787784850.100052:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+9:15591:x1874627728114560:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784850.100082:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784850.100110:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9e4a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72e9f expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.100202:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.100220:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.100685:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101517:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101535:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101546:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101612:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101620:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101628:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101634:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784850.101639:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101648:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101662:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f512c600) 00010000:00010000:2.0:1787784850.101665:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784850.101670:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101690:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101709:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101715:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101722:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101728:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784850.101731:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101737:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101744:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8951fa991600) 00010000:00010000:2.0:1787784850.101746:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784850.101749:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101755:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101838:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9e4a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e9f expref: 10 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101862:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f512c600) 00010000:00010000:2.0:1787784850.101865:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784850.101869:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9e4a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e9f expref: 10 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.101879:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183600, rc 0) 00000100:00100000:2.0:1787784850.102150:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+9:15591:x1874627728114560:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 2100us (3078us total) trans 0 rc 301/301 00000100:00100000:2.0:1787784850.102161:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:0.0:1787784850.117707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784850.117870:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728114688 00000100:00100000:1.0:1787784850.117884:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728114688 00000100:00100000:1.0:1787784850.117974:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:1.0:1787784850.117986:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:41f7da42-7119-46f9-b18b-692347fcebc0+9:15591:x1874627728114688:12345-192.168.202.41@tcp:700:lfs.0 00000100:00100000:1.0:1787784850.118108:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:41f7da42-7119-46f9-b18b-692347fcebc0+9:15591:x1874627728114688:12345-192.168.202.41@tcp:700:lfs.0 Request processed in 123us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784850.118117:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:1.0:1787784850.121764:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784850.122851:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728114944 00000100:00100000:2.0:1787784850.122863:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728114944 00000100:00100000:3.0:1787784850.123121:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:3.0:1787784850.123133:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+9:15591:x1874627728114944:12345-192.168.202.41@tcp:36:lfs.0 00010000:00010000:3.0:1787784850.123208:0:18636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784850.123243:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e3cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e0c expref: 9 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.123261:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f512c600) 00010000:00010000:3.0:1787784850.123265:0:18636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784850.123343:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.123358:0:18636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e40e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e7c expref: 5 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.123369:0:18636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.123421:0:18636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e40e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e7c expref: 5 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.123436:0:18636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e40e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e7c expref: 5 pid: 17107 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784850.123469:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18636:1874627750220672:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787784850.123555:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81dec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784850.126728:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784850.126860:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18636:1874627750220672:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787784850.126885:0:18636:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784850.127027:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728115072 00000100:00100000:1.0:1787784850.127034:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728115072 00010000:00010000:1.0:1787784850.127084:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e40e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e7c expref: 6 pid: 17107 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784850.127125:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:1.0:1787784850.127135:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2405:x1874627728115072:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784850.127151:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784850.127158:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e40e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e7c expref: 6 pid: 17107 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.127186:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e40e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e7c expref: 6 pid: 17107 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.127208:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e40e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e7c expref: 6 pid: 17107 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.127237:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f512c600) 00010000:00010000:1.0:1787784850.127242:0:17094:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.127250:0:17094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.127258:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.127278:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784850.127332:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2405:x1874627728115072:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 198us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784850.127340:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00010000:00010000:0.0:1787784850.127718:0:18636:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.127727:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.127758:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34800/0x88ace7295d9e4bd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.127801:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34800/0x88ace7295d9e4bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.127811:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34800/0x88ace7295d9e4bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.131222:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34400/0x88ace7295d9e4c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.131246:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34400/0x88ace7295d9e4c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.131258:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34400/0x88ace7295d9e4c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787784850.131279:0:18636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa2d8993 reply state 000000005d51d5f6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34400/0x88ace7295d9e4c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.131290:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34400/0x88ace7295d9e4c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.131298:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8950c23c8a00) 00010000:00010000:0.0:1787784850.131301:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787784850.131305:0:18636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787784850.131311:0:18636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787784850.131321:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.131327:0:18636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.131346:0:18636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.131352:0:18636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784850.131357:0:18636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.131364:0:18636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.131375:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f512c600) 00010000:00010000:0.0:1787784850.131378:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784850.131381:0:18636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.131388:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e4b6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787784850.131556:0:18636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa2d8993 reply state 000000005d51d5f6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34800/0x88ace7295d9e4bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.131568:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34800/0x88ace7295d9e4bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.131575:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8950c23c8f00) 00010000:00010000:0.0:1787784850.131577:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787784850.131580:0:18636:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787784850.131914:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+10:15591:x1874627728114944:12345-192.168.202.41@tcp:36:lfs.0 Request processed in 8767us (10144us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787784850.131923:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00080000:3.0:1787784850.133991:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1787784850.246729:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787784850.302198:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784850.302569:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728115200 00000100:00100000:2.0:1787784850.302578:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728115200 00000100:00100000:2.0:1787784850.302693:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:2.0:1787784850.302704:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+10:15599:x1874627728115200:12345-192.168.202.41@tcp:101:lctl.0 00010000:00010000:2.0:1787784850.302730:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784850.302756:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ea6 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.302861:0:17108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.302876:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.302888:0:17108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784850.302960:0:17108:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787784850.302964:0:17108:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787784850.303003:0:17108:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.303028:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ea6 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.303049:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ea6 expref: 11 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.303058:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951fa991600) 00010000:00010000:2.0:1787784850.303062:0:17108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784850.303065:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183200, rc 0) 00000100:00100000:2.0:1787784850.303134:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+11:15599:x1874627728115200:12345-192.168.202.41@tcp:101:lctl.0 Request processed in 431us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784850.303140:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:0.0:1787784850.353360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784850.353469:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728115328 00000100:00100000:2.0:1787784850.353480:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728115328 00000100:00100000:2.0:1787784850.353549:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:2.0:1787784850.353560:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:15600:x1874627728115328:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784850.353582:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784850.353606:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ead expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.353673:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9e4e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.353704:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9e4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.353714:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9e4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784850.353760:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787784850.353764:0:17109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787784850.353829:0:17109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9e4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.353854:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e4d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ead expref: 7 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.353873:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9e4e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ead expref: 6 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.353881:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951fa991600) 00010000:00010000:2.0:1787784850.353884:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784850.353887:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183600, rc 0) 00000100:00100000:2.0:1787784850.353968:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:15600:x1874627728115328:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 409us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784850.353975:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:1.0:1787784850.362470:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784850.362820:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728115456 00000100:00100000:0.0:1787784850.362829:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728115456 00000100:00100000:0.0:1787784850.362907:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:0.0:1787784850.362917:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:15600:x1874627728115456:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787784850.362947:0:18636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784850.362969:0:18636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35400/0x88ace7295d9e4e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72eb4 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363033:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e200/0x88ace7295d9e4ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363047:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e200/0x88ace7295d9e4ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363058:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e200/0x88ace7295d9e4ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363069:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e4f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363075:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363082:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363155:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e4fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363164:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e4fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363187:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e4fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784850.363224:0:18636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787784850.363228:0:18636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784850.363247:0:18636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e4fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363259:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e200/0x88ace7295d9e4ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363265:0:18636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e200/0x88ace7295d9e4ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363271:0:18636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e200/0x88ace7295d9e4ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363277:0:18636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151e200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784850.363281:0:18636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e200/0x88ace7295d9e4ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363288:0:18636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e200/0x88ace7295d9e4ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363300:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951fa991600) 00010000:00010000:0.0:1787784850.363302:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784850.363307:0:18636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e200/0x88ace7295d9e4ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363312:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e200/0x88ace7295d9e4ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363339:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363344:0:18636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e4f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363350:0:18636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363355:0:18636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784850.363358:0:18636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363364:0:18636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e4f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363371:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8950c23c8f00) 00010000:00010000:0.0:1787784850.363374:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784850.363377:0:18636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e4f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363382:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e4f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363410:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35400/0x88ace7295d9e4e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72eb4 expref: 8 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363427:0:18636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e4fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72eb4 expref: 7 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.363444:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8950c23c8a00) 00010000:00010000:0.0:1787784850.363446:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784850.363448:0:18636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151fa00, rc 0) 00000100:00100000:0.0:1787784850.363540:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+7:15600:x1874627728115456:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 623us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784850.363547:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:1.0:1787784850.366739:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784850.367056:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728115584 00000100:00100000:3.0:1787784850.367065:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728115584 00000100:00100000:3.0:1787784850.367142:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:3.0:1787784850.367153:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3577c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:15600:x1874627728115584:12345-192.168.202.41@tcp:900:lfs.0 00000100:00080000:0.0:1787784850.367250:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784850.371278:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3577c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:15600:x1874627728115584:12345-192.168.202.41@tcp:900:lfs.0 Request processed in 4115us (4536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784850.371304:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:1.0:1787784850.383750:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784850.383918:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728115840 00000100:00100000:2.0:1787784850.383928:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728115840 00000100:00100000:2.0:1787784850.383985:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:2.0:1787784850.383996:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3576d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+7:15600:x1874627728115840:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784850.384018:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784850.384051:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e503 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ebb expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784850.384158:0:17108:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787784850.384255:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e503 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ebb expref: 9 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.384271:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951fa991600) 00010000:00010000:2.0:1787784850.384274:0:17108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784850.384279:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e503 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ebb expref: 9 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.384293:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c4183000, rc 0) 00000100:00100000:2.0:1787784850.384368:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3576d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+8:15600:x1874627728115840:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 374us (629us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787784850.384376:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:0.0:1787784850.387479:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784850.387660:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728116096 00000100:00100000:3.0:1787784850.387669:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728116096 00000100:00100000:3.0:1787784850.387721:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:3.0:1787784850.387730:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+8:15600:x1874627728116096:12345-192.168.202.41@tcp:36:lfs.0 00010000:00010000:3.0:1787784850.387824:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784850.387850:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e4fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72eb4 expref: 8 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.387869:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8950c23c8a00) 00010000:00010000:3.0:1787784850.387874:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784850.387920:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e511 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.387933:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e511 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.387942:0:17107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e511 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784850.388148:0:17107:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b16d2a6b reply state 0000000014f8db78 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e511 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.388161:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e511 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.388167:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8950c23c8a00) 00010000:00010000:3.0:1787784850.388170:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1787784850.388172:0:17107:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787784850.388179:0:17107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787784850.388245:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+9:15600:x1874627728116096:12345-192.168.202.41@tcp:36:lfs.0 Request processed in 516us (775us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787784850.388253:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:1.0:1787784850.396285:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784850.396401:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728116352 00000100:00100000:2.0:1787784850.396411:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728116352 00000100:00100000:2.0:1787784850.396474:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:2.0:1787784850.396485:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+9:15600:x1874627728116352:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1787784850.396716:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+10:15600:x1874627728116352:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 232us (441us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787784850.396725:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:1.0:1787784850.405653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784850.405758:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728116608 00000100:00100000:3.0:1787784850.405807:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728116608 00000100:00100000:3.0:1787784850.405865:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:3.0:1787784850.405875:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18bf9c7-fc9c-4760-9682-7ca1091799a6+10:15600:x1874627728116608:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1787784850.405908:0:19997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784850.405931:0:19997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e518 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ec2 expref: -99 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406005:0:19997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e51f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406033:0:19997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e51f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406045:0:19997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e51f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406057:0:19997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e526 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406064:0:19997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e526 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406070:0:19997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e526 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784850.406177:0:19997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787784850.406241:0:19997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e51f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406248:0:19997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e51f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406255:0:19997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e51f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406260:0:19997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784850.406264:0:19997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e51f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406271:0:19997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e51f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406301:0:19997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951fa991600) 00010000:00010000:3.0:1787784850.406304:0:19997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784850.406309:0:19997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e51f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406316:0:19997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e51f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406332:0:19997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e526 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406339:0:19997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e526 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406344:0:19997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e526 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406349:0:19997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784850.406352:0:19997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e526 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406358:0:19997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e526 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406366:0:19997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8950c23c8f00) 00010000:00010000:3.0:1787784850.406369:0:19997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784850.406372:0:19997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e526 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406377:0:19997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e526 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.406422:0:19997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e518 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ec2 expref: 12 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.409668:0:19997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951fa991600) 00010000:00010000:3.0:1787784850.409674:0:19997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787784850.409685:0:19997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e518 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ec2 expref: 12 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.409707:0:19997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0030a00, rc 0) 00000100:00100000:3.0:1787784850.409811:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18bf9c7-fc9c-4760-9682-7ca1091799a6+11:15600:x1874627728116608:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 3937us (4167us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787784850.409820:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:3.0:1787784850.412674:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784850.413716:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728116736 00000100:00100000:1.0:1787784850.413727:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728116736 00000100:00100000:1.0:1787784850.413844:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:1.0:1787784850.413854:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+11:15600:x1874627728116736:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787784850.413877:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784850.413911:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9e534 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ec9 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.414015:0:17108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e53b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.414029:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e53b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.414040:0:17108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e53b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784850.414065:0:17108:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787784850.414068:0:17108:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787784850.414102:0:17108:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e53b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.414128:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9e534 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ec9 expref: 13 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.414145:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e53b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ec9 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.414154:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8950c23c8a00) 00010000:00010000:1.0:1787784850.414157:0:17108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784850.414160:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603e00, rc 0) 00000100:00100000:1.0:1787784850.414224:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+12:15600:x1874627728116736:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 371us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784850.414237:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:1.0:1787784850.423746:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784850.423891:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728116864 00000100:00100000:2.0:1787784850.423914:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728116864 00000100:00100000:2.0:1787784850.423978:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:2.0:1787784850.423990:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+12:15600:x1874627728116864:12345-192.168.202.41@tcp:37:lfs.0 00000100:00100000:2.0:1787784850.433806:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+12:15600:x1874627728116864:12345-192.168.202.41@tcp:37:lfs.0 Request processed in 9771us (10024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784850.433821:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:3.0:1787784850.443001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784850.443108:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728117120 00000100:00100000:1.0:1787784850.443119:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728117120 00000100:00100000:1.0:1787784850.443184:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:1.0:1787784850.443194:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f55fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+12:15600:x1874627728117120:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1787784850.443479:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f55fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+13:15600:x1874627728117120:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 285us (488us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787784850.443487:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00010000:00010000:1.0:1787784850.504398:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784850.546061:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784850.546224:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728117248 00000100:00100000:0.0:1787784850.546233:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728117248 00000100:00100000:0.0:1787784850.546304:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:0.0:1787784850.546315:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+11:15606:x1874627728117248:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1787784850.546335:0:18636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784850.546357:0:18636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9e542 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ed0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546426:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e549 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546450:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e549 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546462:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e549 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546473:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e550 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546498:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546505:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546581:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e400/0x88ace7295d9e557 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546591:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e400/0x88ace7295d9e557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546598:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e400/0x88ace7295d9e557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784850.546630:0:18636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787784850.546635:0:18636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784850.546682:0:18636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e400/0x88ace7295d9e557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546695:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e549 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546701:0:18636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e549 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546707:0:18636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e549 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546713:0:18636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151e000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784850.546717:0:18636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e549 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546731:0:18636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e549 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546745:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951fa991600) 00010000:00010000:0.0:1787784850.546747:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784850.546752:0:18636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e549 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546758:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e549 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546846:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546853:0:18636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e550 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546858:0:18636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e550 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546863:0:18636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784850.546866:0:18636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e550 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546871:0:18636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e550 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546879:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8950c23c8f00) 00010000:00010000:0.0:1787784850.546882:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784850.546884:0:18636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e550 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.546901:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e550 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.547046:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9e542 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ed0 expref: 13 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.547060:0:18636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e400/0x88ace7295d9e557 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ed0 expref: 12 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.547067:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8950c23c8a00) 00010000:00010000:0.0:1787784850.547070:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787784850.547073:0:18636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151e400, rc 0) 00000100:00100000:0.0:1787784850.547304:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+12:15606:x1874627728117248:12345-192.168.202.41@tcp:101:bash.0 Request processed in 990us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784850.547313:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:3.0:1787784850.558567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784850.558698:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728117376 00000100:00100000:2.0:1787784850.558709:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728117376 00000100:00100000:2.0:1787784850.558815:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:2.0:1787784850.558827:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41f7da42-7119-46f9-b18b-692347fcebc0+5:15606:x1874627728117376:12345-192.168.202.41@tcp:900:bash.0 00000100:00100000:2.0:1787784850.559095:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41f7da42-7119-46f9-b18b-692347fcebc0+5:15606:x1874627728117376:12345-192.168.202.41@tcp:900:bash.0 Request processed in 270us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784850.559104:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:2.0:1787784850.562559:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784850.562661:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728117632 00000100:00100000:1.0:1787784850.562670:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728117632 00000100:00100000:1.0:1787784850.562735:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:1.0:1787784850.562746:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+12:15606:x1874627728117632:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1787784850.562809:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784850.562830:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e55e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ed7 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.563012:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.563029:0:17109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e53b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ec9 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.563039:0:17109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.563094:0:17109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e53b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ec9 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.563109:0:17109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e53b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ec9 expref: 12 pid: 17108 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784850.563122:0:17109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17109:1874627750220800:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784850.563203:0:17109:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784850.567243:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784850.567264:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750220928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784850.567345:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784850.567524:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750220928 00000100:00100000:3.0:1787784850.567531:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750220928 00000100:00100000:3.0:1787784850.567576:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787784850.567584:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750220928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787784850.567620:0:17112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787784850.567668:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750220928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784850.568119:0:17109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17109:1874627750220800:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784850.568146:0:17109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784850.568192:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750220928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784850.568366:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787784850.568833:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784850.568846:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750221056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784850.568890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784850.569095:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750221056 00000100:00100000:3.0:1787784850.569101:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750221056 00000100:00100000:3.0:1787784850.569828:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787784850.569839:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750221056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784850.569973:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787784850.570047:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750221056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 210us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784850.570055:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787784850.570477:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750221056:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787784850.571082:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784850.575750:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784850.576247:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728117760 00000100:00100000:0.0:1787784850.576258:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728117760 00010000:00010000:0.0:1787784850.576316:0:17092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e53b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ec9 expref: 13 pid: 17108 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784850.576366:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1787784850.576376:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+13:2405:x1874627728117760:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784850.576412:0:17092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784850.576421:0:17092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e53b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ec9 expref: 13 pid: 17108 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.576445:0:17092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e53b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ec9 expref: 13 pid: 17108 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.576468:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e53b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ec9 expref: 13 pid: 17108 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.576487:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8950c23c8a00) 00010000:00010000:0.0:1787784850.576491:0:17092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.576501:0:17092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.576508:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.576542:0:17092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784850.576603:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+12:2405:x1874627728117760:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 228us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784850.576616:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00010000:00010000:1.0:1787784850.576906:0:17109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.576915:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.576939:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603600/0x88ace7295d9e56c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.576949:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603600/0x88ace7295d9e56c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.576957:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603600/0x88ace7295d9e56c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.577475:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9e573 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.577486:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9e573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.577494:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9e573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784850.577504:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787784850.577532:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.577540:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.577547:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.577553:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784850.577557:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.577565:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.577574:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8950c23c8a00) 00010000:00010000:1.0:1787784850.577577:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784850.577580:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.577596:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e565 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784850.577608:0:17109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba9ae2a1 reply state 0000000094b924a1 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603600/0x88ace7295d9e56c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.577619:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603600/0x88ace7295d9e56c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.577625:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8950c3351500) 00010000:00010000:1.0:1787784850.577628:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787784850.577630:0:17109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787784850.577668:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e55e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ed7 expref: 15 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.577682:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9e573 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ed7 expref: 14 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.577689:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:1.0:1787784850.577691:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787784850.577693:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602c00, rc 0) 00000100:00100000:1.0:1787784850.577751:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+15:15606:x1874627728117632:12345-192.168.202.41@tcp:101:bash.0 Request processed in 15007us (15202us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787784850.577758:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:2.0:1787784850.591642:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784850.591877:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728117888 00000100:00100000:3.0:1787784850.591887:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728117888 00000100:00100000:3.0:1787784850.591953:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:3.0:1787784850.591965:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+15:15606:x1874627728117888:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1787784850.591989:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784850.592010:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e581 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ede expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.592073:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e588 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.592087:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e588 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.592098:0:17107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e588 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784850.592148:0:17107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787784850.592153:0:17107:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787784850.592187:0:17107:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e588 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.592198:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e588 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.592222:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e581 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ede expref: 17 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.592240:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e588 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ede expref: 16 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.592248:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:3.0:1787784850.592251:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784850.592254:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0031000, rc 0) 00000100:00100000:3.0:1787784850.593065:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+16:15606:x1874627728117888:12345-192.168.202.41@tcp:101:bash.0 Request processed in 1096us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784850.593074:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:0.0:1787784850.596573:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784850.596816:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728118144 00000100:00100000:1.0:1787784850.596827:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728118144 00000100:00100000:1.0:1787784850.596887:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:1.0:1787784850.596897:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41f7da42-7119-46f9-b18b-692347fcebc0+16:15606:x1874627728118144:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:1.0:1787784850.597216:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41f7da42-7119-46f9-b18b-692347fcebc0+17:15606:x1874627728118144:12345-192.168.202.41@tcp:35:bash.0 Request processed in 319us (651us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787784850.597225:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:1.0:1787784850.701410:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784850.701961:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728118400 00000100:00100000:3.0:1787784850.701977:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728118400 00000100:00100000:3.0:1787784850.702062:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:3.0:1787784850.702074:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+17:15616:x1874627728118400:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1787784850.702108:0:19997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784850.702135:0:19997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e58f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ee5 expref: -99 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784850.702394:0:19997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787784850.702593:0:19997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e58f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ee5 expref: 19 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.702639:0:19997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951fa991600) 00010000:00010000:3.0:1787784850.702712:0:19997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787784850.702720:0:19997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e58f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ee5 expref: 19 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784850.702739:0:19997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0030a00, rc 0) 00000100:00100000:3.0:1787784850.702992:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+18:15616:x1874627728118400:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 919us (1596us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787784850.703001:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:3.0:1787784850.709873:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784850.709978:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728118656 00000100:00100000:1.0:1787784850.709991:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728118656 00000100:00100000:1.0:1787784850.710066:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:1.0:1787784850.710079:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41f7da42-7119-46f9-b18b-692347fcebc0+18:15616:x1874627728118656:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1787784850.710375:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41f7da42-7119-46f9-b18b-692347fcebc0+19:15616:x1874627728118656:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 298us (517us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787784850.710385:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:1.0:1787784850.755316:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784850.755888:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728118912 00000100:00100000:2.0:1787784850.755902:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728118912 00000100:00100000:2.0:1787784850.755982:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:2.0:1787784850.755994:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+19:15619:x1874627728118912:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787784850.756027:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784850.756057:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e59d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72eec expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.756210:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e5a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.756400:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.763799:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784850.763826:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787784850.763993:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183000/0x88ace7295d9e59d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72eec expref: 22 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.764027:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72eec expref: 21 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784850.764037:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:2.0:1787784850.764040:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784850.764043:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629c00, rc 0) 00000100:00100000:2.0:1787784850.764293:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+21:15619:x1874627728118912:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 8298us (8990us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787784850.764303:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:3.0:1787784850.771888:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784850.772091:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728119040 00000100:00100000:0.0:1787784850.772100:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728119040 00000100:00100000:0.0:1787784850.772163:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:0.0:1787784850.772173:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+21:15619:x1874627728119040:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:0.0:1787784850.772252:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.772270:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.772282:0:17107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.772319:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.772327:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.772334:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.772340:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784850.772344:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.772352:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.772363:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:0.0:1787784850.772367:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784850.772371:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784850.772378:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784850.772463:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+21:15619:x1874627728119040:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 291us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784850.772471:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:3.0:1787784850.775609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784850.775736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784850.776103:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728119424 00000100:00100000:0.0:1787784850.776113:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728119424 00000100:00100000:0.0:1787784850.776164:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1787784850.776174:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41f7da42-7119-46f9-b18b-692347fcebc0+21:15619:x1874627728119424:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:0.0:1787784850.776944:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41f7da42-7119-46f9-b18b-692347fcebc0+22:15619:x1874627728119424:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 767us (1204us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787784850.776954:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1787784850.778345:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728119168 00000100:00100000:1.0:1787784850.778356:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728119168 00000100:00100000:1.0:1787784850.778475:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:1.0:1787784850.778486:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41f7da42-7119-46f9-b18b-692347fcebc0+22:2406:x1874627728119168:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784850.778501:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784850.778527:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e5a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72eec expref: 22 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784850.778547:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:1.0:1787784850.778552:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784850.778608:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41f7da42-7119-46f9-b18b-692347fcebc0+21:2406:x1874627728119168:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 125us (3008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784850.778615:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000040:00080000:0.0:1787784851.015234:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787784851.117107:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784851.117829:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728119680 00000100:00100000:0.0:1787784851.117840:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728119680 00000100:00100000:0.0:1787784851.117905:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:0.0:1787784851.117915:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+21:15650:x1874627728119680:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:0.0:1787784851.117946:0:19997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784851.117968:0:19997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72ef3 expref: -99 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.118079:0:19997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e5c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.118094:0:19997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.118105:0:19997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784851.118133:0:19997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787784851.118254:0:19997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ef3 expref: 24 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.118274:0:19997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ef3 expref: 23 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.118282:0:19997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:0.0:1787784851.118285:0:19997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784851.118288:0:19997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151e000, rc 0) 00000100:00100000:0.0:1787784851.118359:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+23:15650:x1874627728119680:12345-192.168.202.41@tcp:101:cat.0 Request processed in 446us (1265us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787784851.118368:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:0.0:1787784851.134426:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784851.134535:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728119936 00000100:00100000:2.0:1787784851.134545:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728119936 00000100:00100000:2.0:1787784851.134603:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:2.0:1787784851.134613:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41f7da42-7119-46f9-b18b-692347fcebc0+23:15650:x1874627728119936:12345-192.168.202.41@tcp:35:cat.0 00000100:00100000:2.0:1787784851.134954:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41f7da42-7119-46f9-b18b-692347fcebc0+24:15650:x1874627728119936:12345-192.168.202.41@tcp:35:cat.0 Request processed in 342us (539us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787784851.134963:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:1.0:1787784851.143163:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784851.143328:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728120064 00000100:00100000:0.0:1787784851.143339:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728120064 00000100:00100000:0.0:1787784851.143407:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:0.0:1787784851.143430:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41f7da42-7119-46f9-b18b-692347fcebc0+24:2405:x1874627728120064:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784851.143448:0:17092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784851.143472:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e000/0x88ace7295d9e5c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ef3 expref: 24 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.143494:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:0.0:1787784851.143499:0:17092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784851.144388:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41f7da42-7119-46f9-b18b-692347fcebc0+23:2405:x1874627728120064:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 967us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784851.144417:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:3.0:1787784851.216881:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784851.216996:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728120320 00000100:00100000:2.0:1787784851.217005:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728120320 00000100:00100000:2.0:1787784851.217058:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:2.0:1787784851.217070:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+23:15656:x1874627728120320:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:2.0:1787784851.217108:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784851.217129:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9e5ce lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72efa expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.217239:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9e5d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.217254:0:17109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9e573 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ed7 expref: 24 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.217263:0:17109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e588 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ede expref: 24 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.217272:0:17109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9e5d5 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.217306:0:17109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e588 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ede expref: 24 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.217320:0:17109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e588 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ede expref: 24 pid: 17107 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784851.217333:0:17109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c2363c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17109:1874627750221184:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784851.217431:0:17109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9e573 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ed7 expref: 24 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.217440:0:17109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9e573 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ed7 expref: 24 pid: 17109 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784851.217462:0:17109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17109:1874627750221312:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784851.217484:0:17109:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c565d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787784851.220925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784851.220969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784851.221097:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728120576 00000100:00100000:0.0:1787784851.221112:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728120576 00000100:00100000:1.0:1787784851.221140:0:17109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c2363c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17109:1874627750221184:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784851.221160:0:17109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c23603c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17109:1874627750221312:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787784851.221172:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9e573 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ed7 expref: 25 pid: 17109 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784851.221188:0:17109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9e5d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784851.221222:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728120448 00000100:00100000:0.0:1787784851.221228:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728120448 00010000:00010000:0.0:1787784851.221246:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e588 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ede expref: 26 pid: 17107 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784851.221334:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:0.0:1787784851.221346:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41f7da42-7119-46f9-b18b-692347fcebc0+26:2405:x1874627728120576:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784851.221366:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784851.221375:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9e573 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ed7 expref: 26 pid: 17109 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.221389:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9e573 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ed7 expref: 26 pid: 17109 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784851.221407:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:2.0:1787784851.221424:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4039850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41f7da42-7119-46f9-b18b-692347fcebc0+26:2405:x1874627728120448:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784851.221436:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602c00/0x88ace7295d9e573 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ed7 expref: 26 pid: 17109 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.221447:0:17093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784851.221461:0:17093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e588 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ede expref: 25 pid: 17107 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.221462:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:0.0:1787784851.221476:0:17094:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9e5d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.221524:0:17094:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9e5d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.221532:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784851.221605:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41f7da42-7119-46f9-b18b-692347fcebc0+25:2405:x1874627728120576:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 260us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784851.221614:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00010000:00010000:2.0:1787784851.226158:0:17093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e588 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ede expref: 24 pid: 17107 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.226211:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e588 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ede expref: 24 pid: 17107 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.226236:0:17093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:2.0:1787784851.226242:0:17093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9e5d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.226253:0:17093:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9e5d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.226269:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9e5d5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.226320:0:17093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784851.226374:0:17109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9e5d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.226392:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9e5d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784851.226414:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4039850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41f7da42-7119-46f9-b18b-692347fcebc0+23:2405:x1874627728120448:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 4993us (5440us total) trans 0 rc 0/0 00000004:00200000:0.0:1787784851.226435:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:2.0:1787784851.226444:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00010000:00010000:0.0:1787784851.226831:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9e5ce lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72efa expref: 24 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.226859:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9e5d5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72efa expref: 23 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.226869:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:0.0:1787784851.226872:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787784851.226876:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628600, rc 0) 00000100:00100000:0.0:1787784851.226948:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+23:15656:x1874627728120320:12345-192.168.202.41@tcp:101:dd.0 Request processed in 9880us (10077us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787784851.226958:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:0.0:1787784851.235244:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784851.235337:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728120704 00000100:00100000:2.0:1787784851.235350:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728120704 00000100:00100000:2.0:1787784851.235437:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:2.0:1787784851.235449:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+23:15656:x1874627728120704:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:2.0:1787784851.235487:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784851.235522:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9e5e3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f01 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.235575:0:17108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9e5ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.235594:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9e5ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.235607:0:17108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9e5ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.235824:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9e5e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f01 expref: 25 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.235845:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9e5ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f01 expref: 24 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784851.235858:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:2.0:1787784851.235861:0:17108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787784851.235865:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628c00, rc 0) 00000100:00100000:2.0:1787784851.235941:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+24:15656:x1874627728120704:12345-192.168.202.41@tcp:101:dd.0 Request processed in 494us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784851.235957:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:2.0:1787784851.238025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784851.238117:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728120960 00000100:00100000:3.0:1787784851.238129:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728120960 00000100:00100000:3.0:1787784851.238187:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:3.0:1787784851.238196:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+24:15656:x1874627728120960:12345-192.168.202.41@tcp:36:dd.0 00010000:00010000:3.0:1787784851.238519:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e5f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784851.238537:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e5f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784851.238560:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e5f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787784851.238608:0:18636:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787784851.238636:0:18636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b5ce47f reply state 000000004a062fe8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e5f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784851.238651:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e5f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784851.238658:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:3.0:1787784851.238661:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787784851.238666:0:18636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787784851.238916:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+27:15656:x1874627728120960:12345-192.168.202.41@tcp:36:dd.0 Request processed in 719us (902us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787784851.238924:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 45 00000020:00080000:3.0:1787784851.238930:0:18636:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787784851.247144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784851.247264:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728121088 00000100:00100000:0.0:1787784851.247295:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728121088 00000100:00100000:0.0:1787784851.247375:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:0.0:1787784851.247388:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+27:15656:x1874627728121088:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:0.0:1787784851.247420:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784851.247460:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f08 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.247537:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f08 expref: 28 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.247554:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f08 expref: 28 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.247577:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:0.0:1787784851.247580:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784851.247585:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151f600, rc 0) 00000100:00100000:0.0:1787784851.247667:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+28:15656:x1874627728121088:12345-192.168.202.41@tcp:101:dd.0 Request processed in 282us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784851.247675:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:1.0:1787784851.266012:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784851.266192:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728121344 00000100:00100000:0.0:1787784851.266206:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728121344 00000100:00100000:0.0:1787784851.266344:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:0.0:1787784851.266356:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41f7da42-7119-46f9-b18b-692347fcebc0+28:15656:x1874627728121344:12345-192.168.202.41@tcp:103:dd.0 00010000:00010000:0.0:1787784851.266377:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784851.266411:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f08 expref: 28 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.266474:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:0.0:1787784851.266481:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784851.266555:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41f7da42-7119-46f9-b18b-692347fcebc0+27:15656:x1874627728121344:12345-192.168.202.41@tcp:103:dd.0 Request processed in 201us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784851.266564:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:3.0:1787784851.271417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784851.271524:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728121472 00000100:00100000:0.0:1787784851.271540:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728121472 00000100:00100000:0.0:1787784851.271624:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:0.0:1787784851.271638:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+27:15656:x1874627728121472:12345-192.168.202.41@tcp:58:dd.0 00010000:00010000:0.0:1787784851.271872:0:19997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5ff lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.271900:0:19997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.271915:0:19997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784851.273363:0:19997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787784851.273937:0:19997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787784851.274065:0:19997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787784851.274259:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+27:15656:x1874627728121472:12345-192.168.202.41@tcp:58:dd.0 Request processed in 2619us (2853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784851.274270:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:3.0:1787784851.280233:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784851.280432:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728121600 00000100:00100000:0.0:1787784851.280442:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728121600 00000100:00100000:0.0:1787784851.280563:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:0.0:1787784851.280576:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+27:15656:x1874627728121600:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:0.0:1787784851.280623:0:18636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784851.280654:0:18636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9e606 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f0f expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.280710:0:18636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5ff lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.280723:0:18636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9e606 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f0f expref: 28 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.280744:0:18636:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.280758:0:18636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9e606 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f0f expref: 28 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.280814:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:0.0:1787784851.280817:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784851.280821:0:18636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9e606 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f0f expref: 28 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784851.280829:0:18636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151fc00, rc 0) 00000100:00100000:0.0:1787784851.280899:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+28:15656:x1874627728121600:12345-192.168.202.41@tcp:101:dd.0 Request processed in 326us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784851.280906:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 48 00010000:00010000:2.0:1787784851.525997:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784851.590187:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750221568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784851.590268:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784851.590334:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784851.590341:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750221440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784851.590365:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784851.590446:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750221568 00000100:00100000:1.0:1787784851.590454:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750221568 00000100:00100000:1.0:1787784851.590505:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750221440 00000100:00100000:1.0:1787784851.590509:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750221440 00000100:00100000:1.0:1787784851.590529:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784851.590538:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750221568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784851.590568:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787784851.590613:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750221568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784851.590620:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784851.590635:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787784851.590639:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750221440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787784851.590648:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787784851.590665:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750221440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784851.590669:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787784851.590713:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784851.590743:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750221440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784851.590751:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750221568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784851.594798:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750221824:0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.594839:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750221952:0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.594871:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784851.594871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784851.594915:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750222336:0@lo:400:kworker.0 00000100:00100000:2.0:1787784851.594942:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750221696:0@lo:400:kworker.0 00000100:00100000:2.0:1787784851.594985:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784851.595013:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750222208:0@lo:400:kworker.0 00000100:00100000:0.0:1787784851.595014:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750222080:0@lo:400:kworker.0 00000100:00100000:2.0:1787784851.595044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784851.595044:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784851.595063:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750222720:0@lo:400:kworker.0 00000100:00100000:0.0:1787784851.595063:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3412d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750222592:0@lo:400:kworker.0 00000100:00100000:0.0:1787784851.595082:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784851.595105:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750221696 00000100:00100000:2.0:1787784851.595112:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750221696 00000100:00100000:2.0:1787784851.595156:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787784851.595165:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3646:x1874627750221696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784851.595212:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3646:x1874627750221696:12345-0@lo:400:kworker.0 Request processed in 48us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784851.595220:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787784851.595554:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750222464:0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.595587:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750221824 00000100:00100000:3.0:1787784851.595590:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750221824 00000100:00100000:3.0:1787784851.595613:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750222208 00000100:00100000:3.0:1787784851.595615:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750222208 00000100:00100000:3.0:1787784851.595627:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787784851.595639:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750221824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.595670:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750221824:12345-0@lo:400:kworker.0 Request processed in 32us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784851.595676:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787784851.595688:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787784851.595692:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c23603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750222208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.595717:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c23603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750222208:12345-0@lo:400:kworker.0 Request processed in 24us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784851.595722:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787784851.595736:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750221952 00000100:00100000:3.0:1787784851.595739:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750221952 00000100:00100000:3.0:1787784851.595759:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787784851.595798:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750221952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.595828:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750221952:12345-0@lo:400:kworker.0 Request processed in 31us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784851.595834:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784851.598533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784851.598662:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750222336 00000100:00100000:3.0:1787784851.598673:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750222336 00000100:00100000:3.0:1787784851.598742:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787784851.598752:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750222336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784851.599010:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750222848:0@lo:400:kworker.0 00000100:00080000:1.0:1787784851.599078:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784851.599234:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750222336:12345-0@lo:400:kworker.0 Request processed in 482us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784851.599243:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787784851.607370:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750222080 00000100:00100000:3.0:1787784851.607381:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750222592 00000100:00100000:3.0:1787784851.607420:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750222592 00000100:00100000:3.0:1787784851.607516:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787784851.607530:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4165a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750222592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784851.607552:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750222080 00000100:00100000:2.0:1787784851.607580:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787784851.607588:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750222080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784851.609228:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784851.609274:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4165a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750222592:12345-0@lo:400:kworker.0 Request processed in 1746us (14187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784851.609285:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787784851.609298:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750221824:0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.609317:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750222848 00000100:00100000:3.0:1787784851.609325:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750222848 00000100:00100000:1.0:1787784851.609337:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750222336:0@lo:400:kworker.0 00000100:00100000:1.0:1787784851.609393:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784851.609469:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750222464 00000100:00100000:3.0:1787784851.609473:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750222464 00000100:00100000:3.0:1787784851.609494:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787784851.609502:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750222848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.609549:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874627750222848:12345-0@lo:400:kworker.0 Request processed in 47us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784851.609555:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787784851.609567:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787784851.609573:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750222464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.609602:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750222464:12345-0@lo:400:kworker.0 Request processed in 30us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784851.609607:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787784851.610098:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784851.610113:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784851.610153:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750221696:0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.610166:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750222208:0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.610186:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750222720 00000100:00100000:3.0:1787784851.610191:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750222720 00000100:00080000:3.0:1787784851.610206:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784851.610223:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787784851.610229:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1219a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750222720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.610285:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1219a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750222720:12345-0@lo:400:kworker.0 Request processed in 56us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784851.610292:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1787784851.610316:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c1218000 x1874627750222720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784851.610327:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750222720:0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.610526:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874627750222848:0@lo:400:kworker.0 00000100:00100000:2.0:1787784851.610678:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750222080:12345-0@lo:400:kworker.0 Request processed in 3089us (15632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784851.610686:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787784851.610839:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750222592:0@lo:400:kworker.0 00000100:00100000:0.0:1787784851.610859:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3412940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750222080:0@lo:400:kworker.0 00000100:00100000:1.0:1787784851.611815:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1219e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750222976:0@lo:400:kworker.0 00000100:00100000:1.0:1787784851.611870:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784851.612052:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750221952:0@lo:400:kworker.0 00000100:00100000:1.0:1787784851.612064:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750222464:0@lo:400:kworker.0 00000100:00100000:3.0:1787784851.612224:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750222976 00000100:00100000:3.0:1787784851.612231:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750222976 00000100:00100000:3.0:1787784851.612343:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787784851.612354:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750222976:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787784851.612367:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784851.612418:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750222976:12345-0@lo:400:kworker.0 Request processed in 66us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784851.612426:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1787784851.612488:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c1219e00 x1874627750222976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784851.612499:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1219e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750222976:0@lo:400:kworker.0 00000040:00080000:0.0:1787784852.045973:0:17141:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787784852.045984:0:17141:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784852.046020:0:17141:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787784852.046031:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787784852.046200:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c41661c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17141:1874627750223104:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787784852.046303:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d88449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784852.059864:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c41661c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17141:1874627750223104:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787784852.071003:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784852.071116:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728121728 00000100:00100000:1.0:1787784852.071125:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728121728 00000100:00100000:1.0:1787784852.071216:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:1.0:1787784852.071228:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+28:15657:x1874627728121728:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787784852.071260:0:17109:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787784852.071396:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+28:15657:x1874627728121728:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 170us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784852.071404:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00080000:0.0:1787784852.071931:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784852.085598:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784852.085817:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728121856 00000100:00100000:3.0:1787784852.085827:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728121856 00000100:00100000:3.0:1787784852.085902:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:3.0:1787784852.085913:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+28:15657:x1874627728121856:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787784852.085989:0:17108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e60d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086007:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e60d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086021:0:17108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e60d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086100:0:17108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9e614 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086109:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9e614 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086115:0:17108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9e614 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086140:0:17108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030800/0x88ace7295d9e61b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086150:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030800/0x88ace7295d9e61b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086162:0:17108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030800/0x88ace7295d9e61b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784852.086566:0:17108:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787784852.086571:0:17108:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787784852.086588:0:17108:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030800/0x88ace7295d9e61b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086600:0:17108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e60d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086606:0:17108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e60d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086613:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e60d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086632:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784852.086636:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e60d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086644:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e60d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086659:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951fa991300) 00010000:00010000:3.0:1787784852.086662:0:17108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784852.086666:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e60d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086672:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030a00/0x88ace7295d9e60d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086688:0:17108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9e614 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086694:0:17108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9e614 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086699:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9e614 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086705:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784852.086708:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9e614 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086715:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9e614 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086734:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8951f512c700) 00010000:00010000:3.0:1787784852.086737:0:17108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784852.086740:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9e614 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086747:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9e614 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086860:0:17108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030800/0x88ace7295d9e61b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086868:0:17108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030800/0x88ace7295d9e61b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086873:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030800/0x88ace7295d9e61b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086878:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784852.086881:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030800/0x88ace7295d9e61b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086887:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030800/0x88ace7295d9e61b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086896:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:3.0:1787784852.086898:0:17108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784852.086901:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030800/0x88ace7295d9e61b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.086907:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030800/0x88ace7295d9e61b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784852.087101:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+28:15657:x1874627728121856:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 Request processed in 1186us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784852.087119:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:2.0:1787784852.090470:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784852.090602:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728122112 00000100:00100000:3.0:1787784852.090611:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728122112 00000100:00100000:3.0:1787784852.090723:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:3.0:1787784852.090734:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+28:15657:x1874627728122112:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784852.090794:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784852.090815:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030e00/0x88ace7295d9e622 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f16 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.090932:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e629 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.090948:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e629 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.090959:0:17107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e629 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784852.090970:0:17107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787784852.091046:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e629 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.091054:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e629 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.091060:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e629 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.091066:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784852.091070:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e629 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.091102:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e629 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.091115:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:3.0:1787784852.091118:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787784852.091122:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e629 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.091129:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031000/0x88ace7295d9e629 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.091186:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030e00/0x88ace7295d9e622 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f16 expref: 30 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.091196:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951fa991300) 00010000:00010000:3.0:1787784852.091198:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787784852.091202:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030e00/0x88ace7295d9e622 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f16 expref: 30 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.091213:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0030e00, rc 0) 00000100:00100000:3.0:1787784852.091273:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+29:15657:x1874627728122112:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 541us (815us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787784852.091281:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:3.0:1787784852.102718:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784852.102881:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728122240 00000100:00100000:0.0:1787784852.102890:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728122240 00000100:00100000:0.0:1787784852.102957:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:0.0:1787784852.102967:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+29:15657:x1874627728122240:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787784852.103007:0:18636:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787784852.103377:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+29:15657:x1874627728122240:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 410us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784852.103386:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:2.0:1787784852.111688:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784852.111831:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728122496 00000100:00100000:0.0:1787784852.111842:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728122496 00000100:00100000:0.0:1787784852.111907:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:0.0:1787784852.111918:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+29:15657:x1874627728122496:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784852.111937:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784852.111958:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e200/0x88ace7295d9e637 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f1d expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787784852.112372:0:17108:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:0.0:1787784852.112379:0:17108:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1787784852.112400:0:17108:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1787784852.112557:0:17108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e63e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.112737:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e63e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.112747:0:17108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e63e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.112873:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e200/0x88ace7295d9e637 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f1d expref: 32 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.112911:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e63e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f1d expref: 31 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.112919:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c23c8d00) 00010000:00010000:0.0:1787784852.112922:0:17108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784852.112925:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151f200, rc 0) 00000100:00100000:0.0:1787784852.113098:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+31:15657:x1874627728122496:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1182us (1420us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787784852.113105:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:2.0:1787784852.121286:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784852.122832:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728122752 00000100:00100000:3.0:1787784852.122850:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728122752 00000100:00100000:2.0:1787784852.123217:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:2.0:1787784852.123231:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+31:15657:x1874627728122752:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787784852.123320:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784852.123358:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e63e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f1d expref: 31 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124320:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c23c8d00) 00010000:00010000:2.0:1787784852.124350:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784852.124408:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e64c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124566:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e64c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124594:0:17107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e64c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124616:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e653 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x35bc75ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124624:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e653 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35bc75ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124638:0:17107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e653 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35bc75ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124728:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e64c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124736:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e64c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124743:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e64c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124750:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784852.124788:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e64c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124799:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e64c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124811:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8950c23c8a00) 00010000:00010000:2.0:1787784852.124815:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784852.124820:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e64c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124826:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e64c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124840:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e653 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35bc75ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124847:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e653 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35bc75ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124853:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e653 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35bc75ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124879:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784852.124883:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e653 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35bc75ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124891:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e653 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35bc75ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124899:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x35bc75ac (ffff8951fa991400) 00010000:00010000:2.0:1787784852.124901:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784852.124904:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e653 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x35bc75ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.124909:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e653 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x35bc75ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784852.125730:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+30:15657:x1874627728122752:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 2493us (4451us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787784852.125742:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:2.0:1787784852.133202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784852.134225:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728122880 00000100:00100000:1.0:1787784852.134241:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728122880 00000100:00100000:1.0:1787784852.138996:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:1.0:1787784852.139034:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+30:15657:x1874627728122880:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784852.139071:0:19997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784852.139139:0:19997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9e65a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f24 expref: -99 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.139193:0:19997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e661 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.139211:0:19997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e661 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.139226:0:19997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e661 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.139394:0:19997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603c00/0x88ace7295d9e65a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f24 expref: 32 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.139440:0:19997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e661 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f24 expref: 31 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.139451:0:19997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c3351f00) 00010000:00010000:1.0:1787784852.139454:0:19997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787784852.139458:0:19997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602e00, rc 0) 00000100:00100000:1.0:1787784852.139570:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+31:15657:x1874627728122880:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 556us (6385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784852.139578:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:2.0:1787784852.148247:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784852.148580:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728123136 00000100:00100000:0.0:1787784852.148594:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728123136 00000100:00100000:0.0:1787784852.148689:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:0.0:1787784852.148703:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+31:15657:x1874627728123136:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787784852.148881:0:17108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e668 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.148904:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e668 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.149793:0:17108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e668 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784852.150242:0:17108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1787784852.150256:0:17108:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 592399486725ns, next at 593399483212ns, rc = 0 00000004:00010000:0.0:1787784852.150330:0:17108:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc22ae56 reply state 00000000dbbbae33 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e668 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.150376:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e668 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.150401:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c3351f00) 00010000:00010000:0.0:1787784852.150405:0:17108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787784852.152717:0:17108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787784852.154345:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+33:15657:x1874627728123136:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 5630us (6100us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787784852.154371:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:0.0:1787784852.160598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784852.161446:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728123264 00000100:00100000:2.0:1787784852.161463:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728123264 00000100:00100000:2.0:1787784852.161547:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:2.0:1787784852.161559:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c41661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+33:15657:x1874627728123264:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784852.161593:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784852.161623:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e66f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f2b expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.161750:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e66f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f2b expref: 34 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.161816:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e66f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f2b expref: 34 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.161841:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c3351f00) 00010000:00010000:2.0:1787784852.161844:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784852.161848:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628e00, rc 0) 00000100:00100000:2.0:1787784852.161929:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c41661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+34:15657:x1874627728123264:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 372us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784852.161937:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:2.0:1787784852.168726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784852.169061:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728123392 00000100:00100000:3.0:1787784852.169075:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728123392 00000100:00080000:0.0:1787784852.169338:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784852.169602:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:3.0:1787784852.169620:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:2408:x1874627728123392:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787784852.170060:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+6:2408:x1874627728123392:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 445us (1350us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787784852.182308:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:0.0:1787784852.183261:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784852.183626:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728123648 00000100:00100000:2.0:1787784852.183690:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728123648 00000100:00100000:2.0:1787784852.184118:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:2.0:1787784852.184133:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4166d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41f7da42-7119-46f9-b18b-692347fcebc0+34:15657:x1874627728123648:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787784852.184713:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4166d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41f7da42-7119-46f9-b18b-692347fcebc0+35:15657:x1874627728123648:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 583us (1456us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787784852.184722:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:1.0:1787784852.187995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784852.188221:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728123904 00000100:00100000:3.0:1787784852.188235:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728123904 00000100:00100000:3.0:1787784852.188322:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:3.0:1787784852.188335:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+35:15657:x1874627728123904:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787784852.189120:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+35:15657:x1874627728123904:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 784us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784852.189132:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:3.0:1787784852.192845:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784852.193040:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728124032 00000100:00100000:1.0:1787784852.193054:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728124032 00000100:00100000:1.0:1787784852.193136:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:1.0:1787784852.193150:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1218780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+35:15657:x1874627728124032:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784852.193206:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784852.193234:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e676 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f32 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.193366:0:17108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e67d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.193633:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e67d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.193651:0:17108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e67d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784852.193714:0:17108:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787784852.193741:0:17108:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e67d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.193821:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e676 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f32 expref: 37 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.193845:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e67d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f32 expref: 36 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.193855:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c3351f00) 00010000:00010000:1.0:1787784852.193858:0:17108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787784852.193863:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602200, rc 0) 00000100:00100000:1.0:1787784852.194200:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1218780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+36:15657:x1874627728124032:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1051us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784852.194209:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:1.0:1787784852.199440:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784852.199525:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728124160 00000100:00100000:3.0:1787784852.199539:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728124160 00000100:00100000:3.0:1787784852.199612:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:3.0:1787784852.199625:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41f7da42-7119-46f9-b18b-692347fcebc0+6:2406:x1874627728124160:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784852.199660:0:18614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784852.199688:0:18614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e684 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f39 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784852.199723:0:18614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6e94, blocks: 0x0 00010000:00010000:3.0:1787784852.199750:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1787784852.199806:0:18614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784852.199821:0:18614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f39 expref: 7 pid: 18614 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.199884:0:18614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f39 expref: 7 pid: 18614 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.199904:0:18614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0030e00, rc 0) 00000100:00100000:3.0:1787784852.199986:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41f7da42-7119-46f9-b18b-692347fcebc0+7:2406:x1874627728124160:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 363us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784852.199995:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:0.0:1787784852.214391:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784852.214820:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728124416 00000100:00100000:3.0:1787784852.214834:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728124416 00000100:00100000:3.0:1787784852.214925:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:3.0:1787784852.214936:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+36:15657:x1874627728124416:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787784852.215079:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41f7da42-7119-46f9-b18b-692347fcebc0+36:15657:x1874627728124416:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 145us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784852.215089:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:2.0:1787784852.218914:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784852.219090:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728124544 00000100:00100000:3.0:1787784852.219104:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728124544 00000100:00100000:3.0:1787784852.219188:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:3.0:1787784852.219202:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff479a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+36:15657:x1874627728124544:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787784852.222391:0:17087:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1787784852.222411:0:17087:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787784852.222458:0:17087:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1787784852.222631:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff479a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+19:15657:x1874627728124544:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 Request processed in 3427us (3725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784852.222639:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00010000:00010000:0.0:1787784852.222935:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e511 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.222957:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e511 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.222974:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e511 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.222981:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787784852.222995:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e511 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.223005:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e511 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223028:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34800/0x88ace7295d9e4bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.223031:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8950c23c8a00) 00010000:00010000:3.0:1787784852.223044:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34800/0x88ace7295d9e4bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.223057:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787784852.223065:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34800/0x88ace7295d9e4bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.223069:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e511 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.223087:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9e511 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223092:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784852.223101:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34800/0x88ace7295d9e4bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223110:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34800/0x88ace7295d9e4bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223128:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8950c23c8f00) 00000100:00100000:0.0:1787784852.223129:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787784852.223138:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784852.223146:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34800/0x88ace7295d9e4bd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223154:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34800/0x88ace7295d9e4bd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784852.223158:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750223232:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787784852.223192:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34400/0x88ace7295d9e4c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223200:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34400/0x88ace7295d9e4c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223206:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34400/0x88ace7295d9e4c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223213:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784852.223216:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34400/0x88ace7295d9e4c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223222:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34400/0x88ace7295d9e4c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223240:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8950c23c8a00) 00010000:00010000:3.0:1787784852.223244:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784852.223247:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34400/0x88ace7295d9e4c4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223251:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d34400/0x88ace7295d9e4c4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223262:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603600/0x88ace7295d9e56c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223267:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603600/0x88ace7295d9e56c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784852.223273:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784852.223284:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603600/0x88ace7295d9e56c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223288:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784852.223290:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603600/0x88ace7295d9e56c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223299:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603600/0x88ace7295d9e56c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223306:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8950c3351500) 00010000:00010000:3.0:1787784852.223309:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784852.223311:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603600/0x88ace7295d9e56c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223316:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603600/0x88ace7295d9e56c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223340:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e5f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223345:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e5f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223349:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e5f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223351:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784852.223354:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e5f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223357:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e5f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223366:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:3.0:1787784852.223367:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784852.223369:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e5f1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223372:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031c00/0x88ace7295d9e5f1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223382:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e668 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223385:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e668 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223389:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e668 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223399:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151fa00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787784852.223402:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e668 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223406:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e668 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223464:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c3351f00) 00010000:00010000:3.0:1787784852.223465:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787784852.223467:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e668 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.223471:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9e668 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784852.224206:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750223232 00000100:00100000:1.0:1787784852.224214:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750223232 00000100:00100000:1.0:1787784852.224261:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787784852.224274:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750223232:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787784852.224397:0:18612:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787784852.224400:0:18612:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787784852.224401:0:18612:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787784852.224403:0:18612:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787784852 -> 1787784852 00002000:00010000:1.0:1787784852.224405:0:18612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787784852.224552:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750223232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 284us (1295us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787784852.224558:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:0.0:1787784852.225506:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8951ff47b840/2, rc 0, transno 8589934596 00000100:00100000:0.0:1787784852.225523:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750223232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787784852.226232:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784852.226350:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728124672 00000100:00100000:3.0:1787784852.226359:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728124672 00000100:00100000:3.0:1787784852.226400:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:3.0:1787784852.226406:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41f7da42-7119-46f9-b18b-692347fcebc0+7:2406:x1874627728124672:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787784852.226496:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41f7da42-7119-46f9-b18b-692347fcebc0+7:2406:x1874627728124672:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 Request processed in 91us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784852.226501:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:0.0:1787784852.235262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784852.235741:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728124928 00000100:00100000:1.0:1787784852.235816:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728124928 00000100:00100000:1.0:1787784852.235910:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:1.0:1787784852.235922:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+15:15657:x1874627728124928:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787784852.235999:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784852.236037:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e67d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f32 expref: 15 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.236093:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c3351f00) 00010000:00010000:1.0:1787784852.236100:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784852.236141:0:17108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e68b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.236157:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e68b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.236170:0:17108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e68b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784852.236349:0:17108:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b7c0a6d reply state 00000000e8f24c44 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e68b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.236364:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e68b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.236371:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c3351f00) 00010000:00010000:1.0:1787784852.236374:0:17108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787784852.236377:0:17108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784852.236735:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+16:15657:x1874627728124928:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 812us (1487us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787784852.236744:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:2.0:1787784852.241528:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784852.241621:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728125056 00000100:00100000:1.0:1787784852.241639:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728125056 00000100:00100000:1.0:1787784852.241732:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:1.0:1787784852.241746:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41f7da42-7119-46f9-b18b-692347fcebc0+7:15657:x1874627728125056:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784852.241822:0:18612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784852.241884:0:18612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097d48442/0x88ace7295d9e692 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f40 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.241925:0:18612:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e684 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f39 expref: 8 pid: 18614 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.241944:0:18612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784852.241950:0:18612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784852.241957:0:18612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097d48442/0x88ace7295d9e692 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f40 expref: 8 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.242006:0:18612:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f39 expref: 8 pid: 18614 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.242022:0:18612:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e684 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f39 expref: 8 pid: 18614 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784852.242040:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18612:1874627750223360:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784852.242150:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784852.245849:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18612:1874627750223360:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784852.246356:0:18612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097d48442/0x88ace7295d9e692 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f40 expref: 8 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.246402:0:18612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602200, rc 0) 00000100:00100000:1.0:1787784852.246519:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41f7da42-7119-46f9-b18b-692347fcebc0+8:15657:x1874627728125056:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 4775us (5001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784852.246556:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:0.0:1787784852.249646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784852.250069:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728125184 00000100:00100000:3.0:1787784852.250083:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728125184 00010000:00010000:3.0:1787784852.250140:0:20136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e684 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f39 expref: 8 pid: 18614 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784852.250239:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:3.0:1787784852.250284:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41f7da42-7119-46f9-b18b-692347fcebc0+8:2405:x1874627728125184:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784852.250304:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784852.250333:0:20136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e684 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f39 expref: 8 pid: 18614 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.250349:0:20136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f39 expref: 8 pid: 18614 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.250377:0:20136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e684 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f39 expref: 8 pid: 18614 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.250410:0:20136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784852.250416:0:20136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784852.250423:0:20136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097d48442/0x88ace7295d9e692 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f40 expref: 7 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.250446:0:20136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097d48442/0x88ace7295d9e692 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f40 expref: 7 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.250497:0:20136:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000097d48442/0x88ace7295d9e692 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f40 expref: 7 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784852.250515:0:20136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121ad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:20136:1874627750223488:192.168.202.41@tcp:105: 00000100:00100000:3.0:1787784852.250746:0:20136:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c83c9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784852.256120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784852.256242:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728125312 00000100:00100000:1.0:1787784852.256254:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728125312 00000100:00100000:3.0:1787784852.256288:0:20136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121ad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:20136:1874627750223488:192.168.202.41@tcp:105: 00010000:00010000:3.0:1787784852.256339:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784852.256346:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:1.0:1787784852.256362:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41f7da42-7119-46f9-b18b-692347fcebc0+8:2406:x1874627728125312:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787784852.256407:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41f7da42-7119-46f9-b18b-692347fcebc0+8:2405:x1874627728125184:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 6124us (6847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784852.256726:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00002000:00010000:1.0:1787784852.257826:0:18614:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787784852.257833:0:18614:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787784851 00002000:00010000:1.0:1787784852.257837:0:18614:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787784850 00002000:00010000:1.0:1787784852.257839:0:18614:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787784852 -> 1787784851 00002000:00010000:1.0:1787784852.257842:0:18614:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787784852.257981:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41f7da42-7119-46f9-b18b-692347fcebc0+8:2406:x1874627728125312:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 1619us (1871us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787784852.257992:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:2.0:1787784852.262224:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784852.262426:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728125440 00000100:00100000:3.0:1787784852.262544:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728125440 00000100:00100000:3.0:1787784852.262633:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:3.0:1787784852.262653:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+8:2405:x1874627728125440:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787784852.262709:0:18613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.262736:0:18613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097d48442/0x88ace7295d9e692 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f40 expref: 8 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.262746:0:18613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784852.262751:0:18613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784852.262798:0:18613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.262845:0:18613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097d48442/0x88ace7295d9e692 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f40 expref: 8 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.262861:0:18613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097d48442/0x88ace7295d9e692 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f40 expref: 8 pid: 18612 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784852.263154:0:18613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18613:1874627750223616:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787784852.264297:0:18613:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c83c9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784852.270959:0:18613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18613:1874627750223616:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787784852.271001:0:18613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784852.275397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784852.276393:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728125568 00000100:00100000:1.0:1787784852.276420:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728125568 00010000:00010000:1.0:1787784852.276498:0:17093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097d48442/0x88ace7295d9e692 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f40 expref: 9 pid: 18612 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784852.276556:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:1.0:1787784852.276568:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41f7da42-7119-46f9-b18b-692347fcebc0+9:2405:x1874627728125568:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784852.276588:0:17093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784852.276619:0:17093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097d48442/0x88ace7295d9e692 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f40 expref: 9 pid: 18612 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.276647:0:17093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097d48442/0x88ace7295d9e692 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f40 expref: 9 pid: 18612 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.276702:0:17093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097d48442/0x88ace7295d9e692 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f40 expref: 9 pid: 18612 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.276726:0:17093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787784852.276732:0:17093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787784852.276739:0:17093:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.276750:0:17093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.277079:0:18613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.277092:0:18613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.277120:0:18613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.277128:0:18613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.277137:0:18613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.277145:0:18613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784852.277150:0:18613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.277159:0:18613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.277186:0:18613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.277194:0:18613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045b908b4/0x88ace7295d9e699 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784852.277318:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+8:2405:x1874627728125440:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 Request processed in 14666us (15109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784852.277329:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 32 00010000:00010000:1.0:1787784852.277748:0:17093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784852.277835:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41f7da42-7119-46f9-b18b-692347fcebc0+7:2405:x1874627728125568:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 1268us (2459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784852.277845:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:0.0:1787784852.281694:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784852.281829:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728125824 00000100:00100000:1.0:1787784852.281842:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728125824 00000100:00100000:1.0:1787784852.281997:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:1.0:1787784852.282010:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+16:15657:x1874627728125824:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787784852.282219:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.282241:0:18636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9e5ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f01 expref: 16 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.282253:0:18636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.282325:0:18636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9e5ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f01 expref: 16 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.282341:0:18636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9e5ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f01 expref: 16 pid: 17108 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784852.282359:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18636:1874627750223744:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787784852.283440:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784852.289320:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18636:1874627750223744:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784852.289365:0:18636:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784852.292396:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784852.292616:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728125952 00000100:00100000:1.0:1787784852.292629:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728125952 00010000:00010000:1.0:1787784852.292697:0:17092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9e5ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f01 expref: 17 pid: 17108 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784852.292747:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:1.0:1787784852.292811:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41f7da42-7119-46f9-b18b-692347fcebc0+17:2406:x1874627728125952:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784852.292833:0:17092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784852.292841:0:17092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9e5ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f01 expref: 17 pid: 17108 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.292856:0:17092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9e5ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f01 expref: 17 pid: 17108 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.293085:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9e5ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f01 expref: 17 pid: 17108 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.293108:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:1.0:1787784852.293115:0:17092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9e606 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f0f expref: 16 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.293127:0:17092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.293135:0:17092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.293144:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.293223:0:17092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784852.293302:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41f7da42-7119-46f9-b18b-692347fcebc0+16:2406:x1874627728125952:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 545us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784852.293311:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00010000:00010000:3.0:1787784852.300012:0:18636:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784852.300037:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.300585:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.300610:0:18636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e66f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f2b expref: 16 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.300621:0:18636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.301039:0:18636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e66f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f2b expref: 16 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784852.301060:0:18636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e66f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f2b expref: 16 pid: 17107 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784852.301090:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18636:1874627750223872:192.168.202.41@tcp:104: 00000100:00100000:0.0:1787784852.301643:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d88440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784852.316340:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784852.317483:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728126080 00000100:00100000:2.0:1787784852.317499:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728126080 00010000:00010000:2.0:1787784852.317559:0:17093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e66f lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f2b expref: 17 pid: 17107 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784852.317616:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:2.0:1787784852.317629:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5629680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41f7da42-7119-46f9-b18b-692347fcebc0+17:2406:x1874627728126080:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784852.317652:0:17093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784852.317660:0:17093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e66f lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f2b expref: 17 pid: 17107 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.317677:0:17093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e66f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f2b expref: 17 pid: 17107 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.317707:0:17093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c3351f00) 00010000:00010000:2.0:1787784852.317713:0:17093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.317725:0:17093:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.317734:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.317850:0:17093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784852.317938:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5629680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41f7da42-7119-46f9-b18b-692347fcebc0+17:2406:x1874627728126080:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 310us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784852.317947:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00010000:00010000:1.0:1787784852.320299:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628e00/0x88ace7295d9e66f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f2b expref: 16 pid: 17107 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784852.320333:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18636:1874627750223872:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787784852.320364:0:18636:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.320375:0:18636:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.320423:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784852.320588:0:18636:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787784852.320737:0:18636:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787784852.320862:0:18636:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787784852.320989:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18636:1874627750224000:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787784852.321084:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784852.321130:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df665840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784852.321424:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750224000 00000100:00100000:3.0:1787784852.321445:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750224000 00000100:00100000:3.0:1787784852.321527:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787784852.321540:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18636:x1874627750224000:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787784852.321658:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18636:x1874627750224000:12345-0@lo:1000:mdt00_003.0 Request processed in 120us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784852.321666:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787784852.324121:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18636:1874627750224000:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787784852.329089:0:18636:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787784852.329262:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18636:1874627750224128:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787784852.329372:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784852.330338:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33b59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784852.331328:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750224128 00000100:00100000:1.0:1787784852.331344:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750224128 00000100:00100000:0.0:1787784852.331918:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787784852.331932:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff479e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18636:x1874627750224128:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787784852.332290:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff479e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:18636:x1874627750224128:12345-0@lo:1000:mdt00_003.0 Request processed in 360us (2918us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787784852.332301:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787784852.332917:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18636:1874627750224128:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787784852.333219:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333234:0:18636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333244:0:18636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333253:0:18636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784852.333259:0:18636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333268:0:18636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333317:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c3351f00) 00010000:00010000:1.0:1787784852.333321:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784852.333327:0:18636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333333:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9e6a7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333377:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333394:0:18636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5ff lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333400:0:18636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5ff lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333405:0:18636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787784852.333540:0:18636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5ff lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333548:0:18636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5ff lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333557:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:1.0:1787784852.333559:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784852.333567:0:18636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9e606 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f0f expref: 19 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333581:0:18636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9e606 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f0f expref: 19 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333600:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9e606 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f0f expref: 19 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.333696:0:18636:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9e606 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f0f expref: 19 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784852.333712:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18636:1874627750224256:192.168.202.41@tcp:105: 00000100:00100000:1.0:1787784852.334295:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33b59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784852.339507:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784852.339923:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728126208 00000100:00100000:0.0:1787784852.339935:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728126208 00000100:00100000:0.0:1787784852.340019:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:0.0:1787784852.340032:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f55fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41f7da42-7119-46f9-b18b-692347fcebc0+20:15656:x1874627728126208:12345-192.168.202.41@tcp:49:dd.0 00000100:00100000:2.0:1787784852.341790:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18636:1874627750224256:192.168.202.41@tcp:105: 00010000:00010000:2.0:1787784852.341836:0:18636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5ff lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.341850:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9e5ff lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.341908:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9e6ae lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.341926:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9e6ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.341940:0:18636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9e6ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.341954:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9e6ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.341959:0:18636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9e6ae lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.341990:0:18636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9e6ae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.341997:0:18636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784852.342002:0:18636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9e6ae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.342010:0:18636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9e6ae lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.342025:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:2.0:1787784852.342029:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784852.342032:0:18636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9e6ae lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.342039:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629800/0x88ace7295d9e6ae lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.342051:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.342057:0:18636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.342062:0:18636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.342067:0:18636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784852.342070:0:18636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.342086:0:18636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.342097:0:18636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:2.0:1787784852.342099:0:18636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787784852.342102:0:18636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.342107:0:18636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602200/0x88ace7295d9e6a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784852.343016:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f55fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41f7da42-7119-46f9-b18b-692347fcebc0+20:15656:x1874627728126208:12345-192.168.202.41@tcp:49:dd.0 Request processed in 2978us (3588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784852.343030:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000040:00080000:0.0:1787784852.343235:0:17141:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787784852.343240:0:17141:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784852.343261:0:17141:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787784852.343269:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787784852.343611:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+19:15657:x1874627728125824:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 61600us (61929us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787784852.343622:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000020:00080000:2.0:1787784852.343627:0:18636:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787784852.349147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784852.349242:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784852.349586:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728126592 00000100:00100000:2.0:1787784852.349601:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728126592 00000100:00100000:2.0:1787784852.349746:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:2.0:1787784852.349796:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5628b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41f7da42-7119-46f9-b18b-692347fcebc0+19:15657:x1874627728126592:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787784852.351058:0:17111:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787784852.351121:0:17111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787784852.351186:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e6b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.351210:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e6b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.351224:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e6b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.351257:0:17111:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e6b5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784852.356301:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728126336 00000100:00100000:1.0:1787784852.356324:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728126336 00000100:00100000:1.0:1787784852.356454:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:1.0:1787784852.356467:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+22:15656:x1874627728126336:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:1.0:1787784852.356497:0:19997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784852.356527:0:19997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9e6bc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f47 expref: -99 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.356574:0:19997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e6c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.356592:0:19997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.356605:0:19997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.357141:0:19997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602a00/0x88ace7295d9e6bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f47 expref: 24 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.357181:0:19997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e6c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f47 expref: 23 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.357192:0:19997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:1.0:1787784852.357196:0:19997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787784852.357200:0:19997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603e00, rc 0) 00000100:00100000:1.0:1787784852.357290:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+23:15656:x1874627728126336:12345-192.168.202.41@tcp:101:dd.0 Request processed in 826us (8161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784852.357298:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00010000:00010000:2.0:1787784852.369130:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e6b5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.369141:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e6b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.369178:0:17111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787784852.369362:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5628b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41f7da42-7119-46f9-b18b-692347fcebc0+22:15657:x1874627728126592:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 19599us (20113us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787784852.369374:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000020:00080000:2.0:1787784852.369394:0:17111:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787784852.369677:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784852.369685:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e6b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.369694:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784852.369699:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e6b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.369711:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e6b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.369731:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c3351f00) 00010000:00010000:2.0:1787784852.369735:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787784852.369741:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e6b5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.369813:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629c00/0x88ace7295d9e6b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.369831:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784852.369833:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784852.369835:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784852.552633:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784852.668134:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784852.668640:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728126720 00000100:00100000:2.0:1787784852.668651:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728126720 00000100:00100000:2.0:1787784852.668720:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:2.0:1787784852.668730:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41f7da42-7119-46f9-b18b-692347fcebc0+7:2407:x1874627728126720:12345-192.168.202.41@tcp:4:dd.0 00002000:00010000:2.0:1787784852.668831:0:18618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a8f6e93, atime: 0x6a8f6e92, ctime: 0x6a8f6e93, blocks: 0x0 00010000:00010000:2.0:1787784852.668856:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9e6ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.668875:0:18618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1787784852.668880:0:18618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784852.668886:0:18618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9e6ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.668900:0:18618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9e6ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784852.675642:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784852.675923:0:18620:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784852.675947:0:18620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787784852.675975:0:18619:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787784852.676001:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728126848 00000100:00100000:1.0:1787784852.676009:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728126848 00000100:00100000:1.0:1787784852.678606:0:20250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:1.0:1787784852.678635:0:20250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41f7da42-7119-46f9-b18b-692347fcebc0+8:2408:x1874627728126848:12345-192.168.202.41@tcp:4:dd.0 00010000:00010000:1.0:1787784852.678698:0:20250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8d65b62/0x88ace7295d9e6d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.678723:0:20250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784852.678728:0:20250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784852.678736:0:20250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8d65b62/0x88ace7295d9e6d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.678762:0:20250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8d65b62/0x88ace7295d9e6d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784852.822874:0:19429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1787784852.822909:0:19429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1787784852.825731:0:20250:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:1.0:1787784852.825740:0:20250:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787784851 -> 1787784852 00002000:00010000:1.0:1787784852.825743:0:20250:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787784851 -> 1787784852 00002000:00010000:1.0:1787784852.825745:0:20250:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:1.0:1787784852.825813:0:20250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8d65b62/0x88ace7295d9e6d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.825835:0:20250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8d65b62/0x88ace7295d9e6d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.825845:0:20250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8d65b62/0x88ace7295d9e6d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.825853:0:20250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784852.825858:0:20250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8d65b62/0x88ace7295d9e6d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.825868:0:20250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8d65b62/0x88ace7295d9e6d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.825892:0:20250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8d65b62/0x88ace7295d9e6d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784852.825900:0:20250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8d65b62/0x88ace7295d9e6d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784852.826049:0:20250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41f7da42-7119-46f9-b18b-692347fcebc0+7:2408:x1874627728126848:12345-192.168.202.41@tcp:4:dd.0 Request processed in 147419us (150417us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787784852.826061:0:20250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000001:00080000:0.0:1787784852.888416:0:19429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1787784852.888654:0:18618:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1787784852.888674:0:18618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9e6ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.888688:0:18618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9e6ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.888717:0:18618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9e6ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.888725:0:18618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784852.888731:0:18618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9e6ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.888741:0:18618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9e6ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.888791:0:18618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9e6ca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784852.888801:0:18618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9e6ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784852.888974:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41f7da42-7119-46f9-b18b-692347fcebc0+5:2407:x1874627728126720:12345-192.168.202.41@tcp:4:dd.0 Request processed in 220240us (220845us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787784852.888985:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:0.0:1787784853.282573:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784853.282681:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728126976 00000100:00100000:1.0:1787784853.282699:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728126976 00000100:00100000:1.0:1787784853.282804:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00100000:1.0:1787784853.282829:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:2406:x1874627728126976:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784853.282920:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:2406:x1874627728126976:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 106us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784853.282928:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00100000:3.0:1787784853.283644:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784853.283673:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784853.283709:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784853.283736:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728127616 00000100:00100000:3.0:1787784853.283741:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728127616 00000100:00100000:2.0:1787784853.283801:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728127104 00000100:00100000:2.0:1787784853.283807:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728127104 00000100:00100000:2.0:1787784853.283857:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728127360 00000100:00100000:2.0:1787784853.283861:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728127360 00000100:00100000:2.0:1787784853.283884:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:2.0:1787784853.283893:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+5:2405:x1874627728127104:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784853.283944:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+5:2405:x1874627728127104:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 52us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784853.283965:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:0.0:1787784853.283979:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 74 00000100:00100000:0.0:1787784853.283992:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2405:x1874627728127360:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784853.284036:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784853.284036:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2405:x1874627728127360:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 46us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784853.284047:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 74 00000100:00080000:1.0:1787784853.284161:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784853.284165:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784853.284168:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784853.285045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784853.285074:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784853.291000:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728127232 00000100:00100000:3.0:1787784853.291014:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728127232 00000100:00100000:3.0:1787784853.291082:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728127744 00000100:00100000:3.0:1787784853.291100:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728127744 00000100:00100000:2.0:1787784853.291103:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:2.0:1787784853.291118:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2405:x1874627728127616:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784853.291130:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:3.0:1787784853.291141:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41f7da42-7119-46f9-b18b-692347fcebc0+5:2406:x1874627728127232:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784853.291195:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2405:x1874627728127616:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 81us (7484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784853.291203:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:2.0:1787784853.291220:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:2.0:1787784853.291226:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff479680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2406:x1874627728127744:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784853.291269:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728127488 00000100:00100000:0.0:1787784853.291273:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728127488 00000100:00100000:0.0:1787784853.291374:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00100000:0.0:1787784853.291382:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2406:x1874627728127488:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784853.293457:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41f7da42-7119-46f9-b18b-692347fcebc0+5:2406:x1874627728127232:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 2309us (9415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784853.293470:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00080000:3.0:1787784853.293508:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784853.293513:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787784853.293516:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784853.298028:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff479680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2406:x1874627728127744:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 6790us (12942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784853.298045:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:0.0:1787784853.298954:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2406:x1874627728127488:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 7568us (13908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784853.298967:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 75 00010000:00010000:2.0:1787784853.574311:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784854.611054:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784854.662100:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784854.662124:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff478b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750224384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787784854.662195:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784854.662323:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750224384 00000100:00100000:2.0:1787784854.662331:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750224384 00000100:00100000:2.0:1787784854.662400:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787784854.662410:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750224384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784854.662443:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784854.662493:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750224384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784854.662501:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787784854.662587:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff478b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750224384:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787784854.662639:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1787784854.934155:0:20287:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1787784855.180169:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750224512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784855.180232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784855.180946:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750224512 00000100:00100000:3.0:1787784855.180955:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750224512 00000100:00100000:3.0:1787784855.181010:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787784855.181021:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750224512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784855.181054:0:17112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787784855.181118:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750224512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784855.181126:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787784855.181335:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750224512:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787784855.638481:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784855.687049:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784855.687073:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1218f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750224640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784855.687146:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784855.687540:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750224640 00000100:00100000:3.0:1787784855.687548:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750224640 00000100:00100000:3.0:1787784855.687619:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787784855.687629:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750224640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787784855.687673:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787784855.687749:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750224640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784855.687800:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787784855.688277:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1218f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750224640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784855.688470:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784855.688481:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff478b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750224768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784855.688521:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784855.688624:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750224768 00000100:00100000:2.0:1787784855.688628:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750224768 00000100:00100000:2.0:1787784855.688688:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787784855.688697:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5629e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750224768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784855.688714:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784855.688791:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5629e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750224768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784855.688798:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787784855.689230:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff478b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750224768:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787784855.689847:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1787784856.459427:0:17141:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787784856.459441:0:17141:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784856.459464:0:17141:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787784856.459476:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787784856.647733:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784856.712598:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c56283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750224896:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.712706:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.712811:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750225408:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.712840:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.712861:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750225920:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.712880:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.712898:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750226432:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.712920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.712957:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787784856.712964:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750225024:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.712991:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.713010:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750225536:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.713032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.713050:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4166d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750226048:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.713070:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.713336:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4d46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750226560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784856.713366:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.713407:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750225152:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.713450:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.713471:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750225664:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.713492:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.713510:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4d452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750226176:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.713529:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.713547:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787784856.713553:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750225280:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.713574:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.713599:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750225792:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.713618:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.713632:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4d45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750226304:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.713654:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784856.713683:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750224896 00000100:00100000:0.0:1787784856.713691:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750224896 00000100:00100000:0.0:1787784856.713756:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787784856.713784:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3646:x1874627750224896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.713841:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3646:x1874627750224896:12345-0@lo:400:kworker.0 Request processed in 76us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784856.713849:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787784856.713885:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750225408 00000100:00100000:0.0:1787784856.713889:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750225408 00000100:00100000:0.0:1787784856.713910:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750225920 00000100:00100000:0.0:1787784856.713914:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750225920 00000100:00100000:0.0:1787784856.713926:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750226432 00000100:00100000:0.0:1787784856.713928:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750226432 00000100:00100000:0.0:1787784856.716202:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750226048 00000100:00100000:0.0:1787784856.716219:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750226048 00000100:00100000:0.0:1787784856.716248:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750226176 00000100:00100000:0.0:1787784856.716252:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750226176 00000100:00100000:0.0:1787784856.716380:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750226304 00000100:00100000:0.0:1787784856.716383:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750226304 00000100:00100000:0.0:1787784856.716410:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787784856.716421:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750225408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.716530:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750225408:12345-0@lo:400:kworker.0 Request processed in 111us (3688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784856.716537:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787784856.716556:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787784856.716572:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750225920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.716605:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750225920:12345-0@lo:400:kworker.0 Request processed in 34us (3724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784856.716611:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787784856.716622:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787784856.716628:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750226432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.716658:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750226432:12345-0@lo:400:kworker.0 Request processed in 31us (3737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784856.716663:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787784856.716672:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787784856.716677:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750226048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.716700:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750226048:12345-0@lo:400:kworker.0 Request processed in 24us (3629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784856.716705:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787784856.716713:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787784856.716732:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750226176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784856.716887:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750225152 00000100:00100000:2.0:1787784856.716902:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750225152 00000100:00100000:2.0:1787784856.716928:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750225664 00000100:00100000:2.0:1787784856.716931:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750225664 00000100:00100000:2.0:1787784856.716945:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750225280 00000100:00100000:2.0:1787784856.716957:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750225280 00000100:00100000:2.0:1787784856.716972:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750225792 00000100:00100000:2.0:1787784856.716975:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750225792 00000100:00100000:2.0:1787784856.716989:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787784856.716996:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750225152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784856.717044:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750225152:12345-0@lo:400:kworker.0 Request processed in 48us (3595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784856.717050:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787784856.717062:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787784856.717068:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750225664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784856.717204:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750225664:12345-0@lo:400:kworker.0 Request processed in 136us (3710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784856.717211:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787784856.717222:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787784856.717236:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750225280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784856.717279:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750225280:12345-0@lo:400:kworker.0 Request processed in 44us (3704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784856.717284:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787784856.717295:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787784856.717301:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750225792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784856.717327:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750225792:12345-0@lo:400:kworker.0 Request processed in 27us (3709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784856.717332:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787784856.717356:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750226560 00000100:00100000:2.0:1787784856.717361:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750226560 00000100:00100000:2.0:1787784856.717390:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787784856.717397:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750226560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787784856.717423:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787784856.717454:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750226560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (4087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784856.717461:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787784856.717479:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787784856.717486:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750226304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784856.717515:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750226304:12345-0@lo:400:kworker.0 Request processed in 31us (3860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784856.717521:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787784856.717547:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750225024 00000100:00100000:2.0:1787784856.717551:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750225024 00000100:00100000:2.0:1787784856.717575:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750225536 00000100:00100000:2.0:1787784856.717578:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750225536 00000100:00100000:2.0:1787784856.717600:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787784856.717606:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750225024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784856.717639:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750225024:12345-0@lo:400:kworker.0 Request processed in 34us (4647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784856.717645:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787784856.717656:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787784856.717661:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750225536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784856.717689:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750225536:12345-0@lo:400:kworker.0 Request processed in 28us (4657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784856.717696:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787784856.718199:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750226176:12345-0@lo:400:kworker.0 Request processed in 1466us (4666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784856.718206:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787784856.718761:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750225024:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.718799:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750225536:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.718813:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4166d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750226048:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.718835:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4d46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750226560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784856.718858:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c56283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750224896:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.718871:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750225408:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.718881:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750225920:0@lo:400:kworker.0 00010000:00080000:0.0:1787784856.718897:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c4d44000 x1874627750226432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784856.718908:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750226432:0@lo:400:kworker.0 00000100:00080000:0.0:1787784856.719395:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784856.719404:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787784856.719408:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784856.719411:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784856.719435:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1787784856.719442:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8951ff47b840, transno 8589934596 00000004:00080000:0.0:1787784856.719466:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1787784856.719485:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750225280:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.719499:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750225792:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.719512:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4d45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750226304:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.719525:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750225152:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.719536:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750225664:0@lo:400:kworker.0 00010000:00080000:0.0:1787784856.719548:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c4d452c0 x1874627750226176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784856.719558:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4d452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750226176:0@lo:400:kworker.0 00000100:00100000:0.0:1787784856.720381:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750226688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784856.720472:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784856.728036:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750226688 00000100:00100000:1.0:1787784856.728057:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750226688 00000100:00100000:1.0:1787784856.729328:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787784856.729348:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750226688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784856.729381:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787784856.729497:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750226688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (9024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784856.729505:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787784856.731396:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750226688:0@lo:13:osp-pre-1-0.0 Debug log: 43718 lines, 43718 kept, 0 dropped, 0 bad.